Our Retrospective to Accelerate Open Source Test Automation


Second after second, time flies.

Ending the year is a traditional time for introspection. It is the opportunity to step back from the constant rush of activities happening quarter after quarter and plan better for the future.

We performed a retrospective from the last 12 months for the evolution of Cerberus Testing, the open-source test automation platform. We wanted to share with the community our learnings and planning adaptation.

This article summarises the evolution trajectory, sharing past and future improvements. The roadmap is structured in the key area of Experience, Automation, Integrations and Community.

Let’s start with the most visible changes.

Continuously improve the test automation experience

User experience is essential to successful test automation. Our focus in Cerberus Testing has always been to provide faster feedback loops supporting transversal collaboration between the product, engineering and operations team.

The last months brought improvements to ease the onboarding of non-technical users. In-application tutorials made their apparition with guided navigation on the main use-cases. These guides can be activated anytime to expand your initiative.

In addition, the documentation portal was separated into user, administrator and use-cases to better answer each persona’s needs. Combined with all the minor fixes and improvements, the end-to-end experience supports faster iterations.

Figure 1: The tutorials, redesign of the documentation on the left, and the Selenium import on top.

The import of Selenium IDE scenarios made its apparition to accelerate test creation. You can build a test case with a one-click import of the standard format. Leveraging the modular testing capability of Cerberus Testing, you can quickly build your test library.

Next improvements focus on incrementally evolving the user interface to be more reactive and oriented on the use-cases. The end goal is to accelerate the delivery of shippable quality for the teams collaborating on test automation.

To achieve that global performance, the engine and integrations are also evolving.

Keep enriching the core test automation capabilities

The engine of Cerberus Testing provides the core test automation features. It enables the combination of the test repository, test execution and test reporting in a single platform. The variety of use-cases like web, mobile, API test automation evolved.

Erratum is one important feature of self-healing now available in Cerberus. This capability improves the stability of automated tests by finding locators that change using a statistical algorithm. 

Figure 2: Erratum self-healing feature in action to increase the reliability of your tests.

The good part? It only requires one successful execution and not an entire data set to train a machine learning algorithm. And a chrome extension is available to add elements to your actions or controls easily.

That does not end here.

Support the evolution of test automation use-cases

The evolution of digital technologies with distributed, open and reactive systems increase the support required in test automation. We therefore focus on increasing the use-cases covered. Get a highlight of each release by reading these articles on the 4.12 and 4.13.

Concretely, specific needs raised by the community are now supported:

  • Optical Character Recognition (OCR)
  • One Time Password (OTP) 
  • Shadow DOM

We also focus on supporting better the testing of distributed applications for the community. You can already implement SOAP, REST, GraphQL and even Kafka testing inside Cerberus, combining the steps with web or mobile actions. 

Figure 3: The typical use-cases and process to test a Kafka driven application.

Improvements are coming for advanced cases like the support for Avro schema. These requirements reinforce the need for connectivity within the ecosystem. More partners are expected in the near future in the test repository, execution and reporting.

That’s why we are building a platform to accelerate the integrations.

Accelerate test automation with more integrations

The capability to interact with other systems is essential to improve test automation. We have to quickly add new tests, connect them with an existing referential, execute tests in various devices and in different clouds—all of that keeping visibility.

The public APIs of Cerberus Testing was already used for specific integrations via scripting when a native integration was not available. While this works, we worked to drastically improve the APIs integration experience.

The APIs were enriched following a DDD approach to respond to more integration needs. Additionally, the security keys and public APIs portal are now available to accelerate your integration, but also that of external partners.

Figure 4: The DDD public APIs of Cerberus Testing now available.

The need for integration is being worked at three levels:

  • Test repository to sync requirements referential (e.g. JIRA/Xray, Yest)
  • Test execution for execution farms (LambdaTest) or notifications.
  • Test reporting to export and consolidate execution data.

The public APIs aim to accelerate the integration of external products for these use-cases. Feel free to share with us if you identify a valuable use case or want to work on an integration with us.

In the meanwhile, Google Chat and Microsoft Teams are now part of the standard integrations available to receive notifications. Event hooks are also appearing to let you define flexibility reactions to defined events happening in Cerberus Testing.

Animating the community is the best way to keep focusing on value.

Keep investing and growing the community

Our open-source community officially started in 2013. We are now more than 30 contributors to the product completed by the larger user community in various companies and sectors. The content evolved to improve collaboration.

The initial and common way to share is still through the Slack channels. The #general feed is the most used to regularly share questions and practices. Join the community Slack here or ask for an invite on GitHub here

Figure 5: The GitHub stats of Cerberus Testing with more than 30 contributors.

Enriching the content was also one of our priorities. The video library is enriched with tutorials and meetups videos on the Youtube channel. In addition, regular articles are available for you to Follow on Medium.

A series of presentations at testing conferences and meetups was also the opportunity to interact with the larger community. One workshop of continuous testing was held at the main testing & quality conference in France (JFTL). Join the Meetup group here.

The focus is to continue growing and improving.

Join the open-source test automation platform

Continuous improvement is essential to provide an incremental value. The shared direction on the different areas of experience, capabilities, integrations will make the difference to improve your test automation journey.

We aim to accelerate more teams searching for fast feedback loops of continuous testing. The current ecosystem is pushing for continuous value delivery; there is no time to lose in coding yet another framework.

Our mantra “Stop Coding, Start Testing” has been pushing Cerberus Testing in the Cloud with no installation and operations workload on your end. You can create more value for the business by focusing on the product.

Start for free here.

Leave a comment

Your email address will not be published. Required fields are marked *

Cerberus-Testing Terms Of Service

Website Terms and Conditions of Use

1. Terms

By accessing this Website, accessible from http://vgeouyk.cluster030.hosting.ovh.net, you are agreeing to be bound by these Website Terms and Conditions of Use and agree that you are responsible for the agreement with any applicable local laws. If you disagree with any of these terms, you are prohibited from accessing this site. The materials contained in this Website are protected by copyright and trade mark law. These Terms of Service has been created with the help of the Terms of Service Generator and the Privacy Policy Template.

2. Use License

Permission is granted to temporarily download one copy of the materials on Cerberus Testing's Website for personal, non-commercial transitory viewing only. This is the grant of a license, not a transfer of title, and under this license you may not:

  • modify or copy the materials;
  • use the materials for any commercial purpose or for any public display;
  • attempt to reverse engineer any software contained on Cerberus Testing's Website;
  • remove any copyright or other proprietary notations from the materials; or
  • transferring the materials to another person or "mirror" the materials on any other server.

This will let Cerberus Testing to terminate upon violations of any of these restrictions. Upon termination, your viewing right will also be terminated and you should destroy any downloaded materials in your possession whether it is printed or electronic format.

3. Disclaimer

All the materials on Cerberus Testing’s Website are provided "as is". Cerberus Testing makes no warranties, may it be expressed or implied, therefore negates all other warranties. Furthermore, Cerberus Testing does not make any representations concerning the accuracy or reliability of the use of the materials on its Website or otherwise relating to such materials or any sites linked to this Website.

4. Limitations

Cerberus Testing or its suppliers will not be hold accountable for any damages that will arise with the use or inability to use the materials on Cerberus Testing’s Website, even if Cerberus Testing or an authorize representative of this Website has been notified, orally or written, of the possibility of such damage. Some jurisdiction does not allow limitations on implied warranties or limitations of liability for incidental damages, these limitations may not apply to you.

5. Revisions and Errata

The materials appearing on Cerberus Testing’s Website may include technical, typographical, or photographic errors. Cerberus Testing will not promise that any of the materials in this Website are accurate, complete, or current. Cerberus Testing may change the materials contained on its Website at any time without notice. Cerberus Testing does not make any commitment to update the materials.

6. Links

Cerberus Testing has not reviewed all of the sites linked to its Website and is not responsible for the contents of any such linked site. The presence of any link does not imply endorsement by Cerberus Testing of the site. The use of any linked website is at the user’s own risk.

7. Site Terms of Use Modifications

Cerberus Testing may revise these Terms of Use for its Website at any time without prior notice. By using this Website, you are agreeing to be bound by the current version of these Terms and Conditions of Use.

8. Your Privacy

Please read our Privacy Policy.

9. Governing Law

Any claim related to Cerberus Testing's Website shall be governed by the laws of fr without regards to its conflict of law provisions.

Thank you for your interest in cerberus,

In order to proceed with your SaaS we need some in order to confirm your instances accesses.

Please provide accurate contacts to secure the process.

You can cancel any time the subscription, please read Terms of Use.