Cerberus Testing, The Open Source Test Automation Framework

Software Testing grew in interest as a key business digitization enabler. The last World Quality Report of 2019-2020 ranked as #1 benefits its contribution to business objectives and growth. Yet, the software testing industry still reports major pain points related to test  maintenance, automation, tooling and skills. Tooling is either lacking or too complex to integrate, not providing enough intelligence nor ease of use. In this article, we will introduce Cerberus Testing, a test automation solution built within retail players through their digitization, with a key focus on usability, scalability and integration of the test lifecycle process.

Figure 1: Cerberus supporting the test lifecycle to accelerate feedback loops

First lines of code started in 2010 to explore a solution

The first lines of code started in 2010 at La Redoute, a clothing fashion retail player from France. The objectives were to automate manual non-regression tests for existing web applications to accelerate and increase quality of software delivery. At that time, existing solutions were mainly commercial, trying to address specific silos such as test repository, execution or analytics. This is why the decision taken was to start an in-house solution, to enable iterations through test management, execution and reporting in minutes instead of weeks.

Cerberus became the official name extending its usage

Cerberus was officially born after its successful detection of dangerous release defects! The first product increment allowed to perform first automated functional testing for an internal CRM solution. A key requirement was to limit coding for usability, reuse and keeping tests simple. It was based on Selenium web driver and a three-tier traditional architecture with a Java technological stack. The name was retained for its reference to the Guard of the Hell in the Greek Mythology, joining the three test silos and enabling Web, API and Database tests. 

The decision to move in Open-Source in 2013

In the meanwhile, Cerberus started to be used for the testing of the e-commerce platform.  Sharing within the industry, our peers were still struggling with their test automation effort. We decided the move in 2013, convinced by the value of open-source for product innovation and development. Cerberus was released on Sourceforge and GitHub under a GNU General Public License, allowing a first sharing within our local community. Having in mind the limitations of open-source projects, we address as a continuous effort code quality, documentation and sharing via the platform. 

Figure 2: Cerberus Github repository with more than 6000+ commits, 100 stars, and 29 contributors

During this period, challenging digital transformation were happening requiring to guarantee  full regression test automation and monitoring. We focused on improving the flexibility in test management, execution scalability and traceability to mee those objectives. The possibility to implement end-to-end tests in addition to functional tests was a key benefit during that period. It enabled to accelerate by more than x10 the software delivery cycle for specific players. You can read more about the La Redoute case study for 96% Daily Deploys and its 6000+ Automated Test here.

A gradual adoption by Retail Players to solve common problems

Retails players within the same geographical areas started to gain interest: Decathlon, Norauto, Leroymerlin, Midas. Thanks to the emerging community of testers, Cerberus started to be shared outside of its initial wall. They used the solution to support the acceleration of their digital transformation, mainly for their e-commerce and back-office transformations.

Figure 3: Cerberus supporting digital transformation with test automation and integrations

This is a period where Cerberus added standard integrations to increase its usage. Jenkins plugin was a key piece to facilitate deployment of CI/CD pipelines with test automation and feedback. The support of REST API, advanced scheduling, retries and screenshots capabilities altogether enable to accelerate the testing cycle-time. Leroymerlin leverages Cerberus for their mobile testing at scale, read more on their article.

Cerberus support key use-cases for implementing Continuous Testing

With recent and ongoing updates, you can leverage Cerberus for various use-cases from development to operations. You can increase your digital experience test coverage executing the tests on a variety of browsers, devices and apps. The native connectors for APIs (SOAP, REST), desktop applications, Apache Kafka® support a variety of use-cases : legacy, APIs, event-driven microservices, streaming, BI and data science applications.

During the software development lifecycle, Cerberus support fast iterations between test management, execution and reporting. You accelerate using test specifications in plain english, test composition via a library, parallel execution on various devices and advanced reporting. Native integration with CI/CD solution (Jenkins, Bitbucket, …) combined with one-click opening in ticketing tools like JIRA allow faster and easier bug resolution. 

Figure 4: Cerberus supports various use-cases for software delivery and testing cycle

To close the loop, you can leverage Cerberus to monitor your customer experience and business operations. The tests executed can be functional and technical, allowing to test complex scenarios. TF1, the number one TV channel in France is using it for its streaming platform quality assurance. Advanced scheduling, alerting and notifications leave you time to focus on more important activities. Web performance and analytics dashboards are also available to let you identify bottlenecks with 3rd-party integration, or specific customer experience limitations.

Now & Beyond, Expanding

Animate and growing the community is a key focus for us. We are convinced that working in network can accelerate the product adoption and development. We have been holding community meetings every 2 weeks to align the product roadmap and improvement, balancing our product vision and community needs. Evolving our integrations and usability is a key driver for us for a successful product experience. 

You can freely access Cerberus on github, follow us for update, engage in the social medias, on the community slack, and star it if you like it!

Leave a comment

Your email address will not be published. Required fields are marked *

Cerberus-Testing Terms Of Service

Website Terms and Conditions of Use

1. Terms

By accessing this Website, accessible from http://vgeouyk.cluster030.hosting.ovh.net, you are agreeing to be bound by these Website Terms and Conditions of Use and agree that you are responsible for the agreement with any applicable local laws. If you disagree with any of these terms, you are prohibited from accessing this site. The materials contained in this Website are protected by copyright and trade mark law. These Terms of Service has been created with the help of the Terms of Service Generator and the Privacy Policy Template.

2. Use License

Permission is granted to temporarily download one copy of the materials on Cerberus Testing's Website for personal, non-commercial transitory viewing only. This is the grant of a license, not a transfer of title, and under this license you may not:

  • modify or copy the materials;
  • use the materials for any commercial purpose or for any public display;
  • attempt to reverse engineer any software contained on Cerberus Testing's Website;
  • remove any copyright or other proprietary notations from the materials; or
  • transferring the materials to another person or "mirror" the materials on any other server.

This will let Cerberus Testing to terminate upon violations of any of these restrictions. Upon termination, your viewing right will also be terminated and you should destroy any downloaded materials in your possession whether it is printed or electronic format.

3. Disclaimer

All the materials on Cerberus Testing’s Website are provided "as is". Cerberus Testing makes no warranties, may it be expressed or implied, therefore negates all other warranties. Furthermore, Cerberus Testing does not make any representations concerning the accuracy or reliability of the use of the materials on its Website or otherwise relating to such materials or any sites linked to this Website.

4. Limitations

Cerberus Testing or its suppliers will not be hold accountable for any damages that will arise with the use or inability to use the materials on Cerberus Testing’s Website, even if Cerberus Testing or an authorize representative of this Website has been notified, orally or written, of the possibility of such damage. Some jurisdiction does not allow limitations on implied warranties or limitations of liability for incidental damages, these limitations may not apply to you.

5. Revisions and Errata

The materials appearing on Cerberus Testing’s Website may include technical, typographical, or photographic errors. Cerberus Testing will not promise that any of the materials in this Website are accurate, complete, or current. Cerberus Testing may change the materials contained on its Website at any time without notice. Cerberus Testing does not make any commitment to update the materials.

6. Links

Cerberus Testing has not reviewed all of the sites linked to its Website and is not responsible for the contents of any such linked site. The presence of any link does not imply endorsement by Cerberus Testing of the site. The use of any linked website is at the user’s own risk.

7. Site Terms of Use Modifications

Cerberus Testing may revise these Terms of Use for its Website at any time without prior notice. By using this Website, you are agreeing to be bound by the current version of these Terms and Conditions of Use.

8. Your Privacy

Please read our Privacy Policy.

9. Governing Law

Any claim related to Cerberus Testing's Website shall be governed by the laws of fr without regards to its conflict of law provisions.

Thank you for your interest in cerberus,

In order to proceed with your SaaS we need some in order to confirm your instances accesses.

Please provide accurate contacts to secure the process.

You can cancel any time the subscription, please read Terms of Use.