An award-winning Mid-Atlantic payment solutions provider needed to improve its regression testing scope and coverage as part of the Quality Assurance program for its rapidly expanding business. The client was looking to mitigate risk, provide quicker defect detection, reduce costs and improve the overall functionality of their existing commerce platform.

Challenge:

The client wanted to improve its speed to market for a growing customer base while ensuring high-quality results from its application. As a payment processor, an error-free platform for its users was crucial to its business. Any failures, or lack of functionality would have implications beyond user frustration and could impact important payment dates and amounts. The client was dedicated to Agile Development methodologies but needed to add continuous testing, through test automation capabilities, to complement its continuous integration and continuous delivery (CI/CD) goals. As an additional challenge, the client lacked the resources and in-house expertise to create and implement the required test automation framework. The client ultimately needed a way to incorporate testing into its business operations, without it getting in the way of doing business.

Solution:

DecisivEdge’s QA automation team designed and developed a Selenium test automation framework to address all of the client’s concerns in a broad but efficient manner.

Why test automation? Test automation facilitates the kind of test repeatability and speed needed by the client for its highly-interactive and responsive payment processing software. DecisivEdge used its expertise in Selenium’s open-source test automation to create a flexible solution. Ultimately, the decision to deploy automated testing in any organization must be strategic and based on a thorough understanding of goals and operations – the kind of knowledge DecisivEdge gains about its clients during a consultation.

Why Selenium? There is a saying in software development that goes,”fix one bug, and open the door to a bunch of new ones.” This vulnerability as code is modified and improved is why regression testing is required. It goes hand in hand with the continuous testing methodology of Agile development.

Additional Benefits of Selenium Testing:

  • Open Source. The value of open source software reaches beyond cost savings. Open source communities add value to pre-built applications by enabling collaboration and sharing. Selenium’s open source accessibility permits a wealth of knowledge to be cultivated continuously by a wide array of developers. This means that there are active contributions to its knowledge base for developers to call upon.
  • Multiple Browser Compatibility. Selenium’s browser compatibility permits multiple  instances to run across numerous browsers allowing parallel testing which results in increased speed and efficiency.
  • Multiple programming language use. Although Selenium has its own scripting language, you are not limited to its use and can run languages that developers for a particular application are most comfortable with. Evaluate existing data management governance policies and make recommendations related to the enhancement and implementation of stewardship and governance policies to ensure the on-going integrity of the data warehouse.
  • Integration ease with various testing platforms so that continuous testing goals are met.

Specifics of DecisivEdge’s Solution

The custom Selenium test automation framework designed by DecisivEdge was coded in C#, which was the native language of the payment processing platform. The framework, which provides the structure of the test environment, was used to steer automated test cases using the client’s two Enterprise Portals and eight separate branded versions for its users. This permitted the client to view and evaluate the actual user experience across its platform.

In developing the specifics of the tests, DecisivEdge consulted with the client about how the business operated, including what problems its users reported, and how they hoped to improve the user experience. Based on this information, the QA Automation Team created 454 automated test cases running nearly 13,500 test steps. To begin, effective test automation requires coming up with good manual tests. These tests covered potential failure points more comprehensively, and automation permitted the quick and continuous testing the client desired.

Results

Automating these tests helped reduce the time it takes to manually perform regression testing on the Enterprise Public Portal from 24 hours to six hours, a 75% reduction in total hours. This allowed the client to reduce the employee need from three testers to one tester.

In addition to reducing the application testing time, the custom-built solution pinpointed potential errors more efficiently for the client. DecisivEdge’s work with the client is ongoing, and as the team continues to enhance the framework and increase the number of test cases, we expect to see even more impressive efficiency improvements.


To learn more about our Quality Assurance Practice, click here.