Look. This is How To Test For Speed.

cerberus-testing-this-is-how-to-test-for-speed-featured

More than 83% of people expect a web page to load in three seconds or less.We easily think about features for testing a software, but functionalities can lose their value if the non-functional requirements are not met.

Performance is one of the most important non-functional requirements. The Google web core vitals are now focused on the human perception of speed. These metrics even impact the overall ranking of the site, and in the end, potential users.

Your users expect a fast and reliable user experience. Your responsibility is to ensure these requirements are systematically met. While test automation products can test the features, they fall short on testing requirements of response time.

In this article, you will learn how to test the performance of your application with automated tests. We will rely on Cerberus Testing to stop coding and start testing:

  • Define your pages speed requirement
  • Configure the required action and control
  • Verify and deploy your test in your environment
  • Expand your quality with a scalable framework

Let’s start by defining the scope of our tests.

Define your pages speed requirement

Your first priority is to define the pages that will mainly benefit from testing response time. A structured and user-centric approach is to cascade the pages from your most valuable customer journeys.

From that point, you can then work by exclusion. Your pages with the most traffic and impacting the conversion rate are the most important: homepage, products browsing and checkout experience. On the contrary, a page rarely accessed that will load the invoices history is probably less important.

Figure 1: The example of eCommerce customer journeys. Oberlo.

Your next task is to define the speed requirement for each page. That can be done simply in an excel spreadsheet to validate with your product and engineering team. You can even incubate a part of SRE with emerging SLO and SLAs. For example, you can set your checkout page to always load under 2.5 seconds.

You are now ready to set the test case parameters.

Configure the required action and control

The implementation of the controls is done in low-code with Cerberus Testing. For each page you want to test, you have to define one action and one control.

The action “setNetworkTrafficContent” is required to collect the necessary performance data. You can read this article to see how to configure the collector. Cerberus Testing will natively calculate a series of valuable metrics to enable additional verifications.

Figure 2: The 2 actions you need in Cerberus Testing to Test for Speed.

Then, you need one control on the element holding the total duration “$.stat.internal.time.totalDuration”. To test the response time, we choose a numerical comparison under the value of 2580 ms.

You are now ready to Test for Speed.

Verify and deploy your test in your environment

You can run the test manually for a first run. You just have to use the web interface of Cerberus Testing from the test case or the execution menu.

The test execution will provide native test traceability and reporting. You can see all actions and controls performed with their associated results. Your control on the page load will also start to collect valuable metrics of performance over time.

Figure 3: You can access the page load time and other metrics natively in Cerberus Testing.

You can now deploy your test across the software delivery pipeline. You can shift-left by configuring quality gates in CI/CD across your various environments. You can also shift-right by scheduling the test on a regular basis in staging and production.

A ready-to-use framework is what enables you to focus on testing.

Expand your quality with a scalable framework

You are now ready to Test for Speed on the user journeys and pages identified. You can build upon the same structure of action and control on expected response time.

While growing your test suite, you can go further leveraging reusable parameters across tests. You can also activate your tests in different countries. You can complement your production monitoring by running your tests continuously in production.

The best signal of value is when a software change won’t impact the user experience with your automated tests. Your Test for Speed will contribute to a successful product unlocking the truth about continuous testing.

Look. Stop coding and start testing. Now, for free, here.

Leave a comment

Your email address will not be published. Required fields are marked *

Cerberus-Testing Terms Of Service


Website Terms and Conditions of Use

1. Terms

By accessing this Website, accessible from http://vgeouyk.cluster030.hosting.ovh.net, you are agreeing to be bound by these Website Terms and Conditions of Use and agree that you are responsible for the agreement with any applicable local laws. If you disagree with any of these terms, you are prohibited from accessing this site. The materials contained in this Website are protected by copyright and trade mark law. These Terms of Service has been created with the help of the Terms of Service Generator and the Privacy Policy Template.

2. Use License

Permission is granted to temporarily download one copy of the materials on Cerberus Testing's Website for personal, non-commercial transitory viewing only. This is the grant of a license, not a transfer of title, and under this license you may not:

  • modify or copy the materials;
  • use the materials for any commercial purpose or for any public display;
  • attempt to reverse engineer any software contained on Cerberus Testing's Website;
  • remove any copyright or other proprietary notations from the materials; or
  • transferring the materials to another person or "mirror" the materials on any other server.

This will let Cerberus Testing to terminate upon violations of any of these restrictions. Upon termination, your viewing right will also be terminated and you should destroy any downloaded materials in your possession whether it is printed or electronic format.

3. Disclaimer

All the materials on Cerberus Testing’s Website are provided "as is". Cerberus Testing makes no warranties, may it be expressed or implied, therefore negates all other warranties. Furthermore, Cerberus Testing does not make any representations concerning the accuracy or reliability of the use of the materials on its Website or otherwise relating to such materials or any sites linked to this Website.

4. Limitations

Cerberus Testing or its suppliers will not be hold accountable for any damages that will arise with the use or inability to use the materials on Cerberus Testing’s Website, even if Cerberus Testing or an authorize representative of this Website has been notified, orally or written, of the possibility of such damage. Some jurisdiction does not allow limitations on implied warranties or limitations of liability for incidental damages, these limitations may not apply to you.

5. Revisions and Errata

The materials appearing on Cerberus Testing’s Website may include technical, typographical, or photographic errors. Cerberus Testing will not promise that any of the materials in this Website are accurate, complete, or current. Cerberus Testing may change the materials contained on its Website at any time without notice. Cerberus Testing does not make any commitment to update the materials.

6. Links

Cerberus Testing has not reviewed all of the sites linked to its Website and is not responsible for the contents of any such linked site. The presence of any link does not imply endorsement by Cerberus Testing of the site. The use of any linked website is at the user’s own risk.

7. Site Terms of Use Modifications

Cerberus Testing may revise these Terms of Use for its Website at any time without prior notice. By using this Website, you are agreeing to be bound by the current version of these Terms and Conditions of Use.

8. Your Privacy

Please read our Privacy Policy.

9. Governing Law

Any claim related to Cerberus Testing's Website shall be governed by the laws of fr without regards to its conflict of law provisions.

Thank you for your interest in cerberus,

In order to proceed with your SaaS we need some in order to confirm your instances accesses.

Please provide accurate contacts to secure the process.

You can cancel any time the subscription, please read Terms of Use.