Improve Regression Testing Coverage and Save Time with HCL DevOps Test
What we achieved
-
Reduce
level of effort in executing regression tests
-
Client
advocacy + Support Team
-
Increase
capacity to automate tests for new features
To who
-
Industry Information Technology
-
Products: HCL DevOps Test
-
Region EMEA
Overview
-
Part 1
Challenge
The HCL Domino team needed to improve their regression testing coverage and reduce the time to execute tests.
-
Part 2
Solution
The Domino team has an Eclipse-based RCP application, and their test automation solution leverages TestNG to implement their data-driven automation framework.
-
Part 3
Results
Overall, the team reduced the level of effort in executing their regression tests from more than 15 effort weeks (or 600+ hours) to 32 hours – a savings of at least 568 hours, or 95% reduction in effort.
The Challenge
The HCL Domino team needed to improve their regression testing coverage and reduce the time to execute tests. They were running all their regression tests manually, and for the existing product features, that took a team of three people more than two full weeks to execute those tests. They also had a large set of tests to validate the 16 languages that Domino supports, as well as applying fixpacks and performing upgrades.
The team had previously used Rational Functional Tester, so they were familiar with its capabilities. Unfortunately, they had some turnover on their team, and the new team members had to upskill on the HCL DevOps Test UI software. With some classroom training and recorded videos of their test automation framework from the existing team, the new team members were able to be self-sufficient with DevOps Test UI in just three weeks.
The Solution
The Domino team has an Eclipse-based RCP application, and their test automation solution leverages TestNG to implement their data-driven automation framework. All the UI objects are stored in a common repository so there is no redundancy in their scripts and maintenance becomes extremely efficient.
With the need to test on 16 different languages, the team created a single DevOps Test script that selects the language, making the tests highly reusable and easy to maintain. They also have single scripts for removing a language and replacing a language for the server language pack component.
For upgrade and fixpack tests, they support three major versions with a single test script for all upgrades that includes the logic needed for the specific upgrade. For example, they test upgrades from version 10.x to 12.x – with more than 20 possible combinations.
HCL Domino can have a single server or partition servers, and all their upgrade, fixpack, and server language pack tests support both configurations. They also test both GUI installations and silent installations for all possible combinations. Normal installation and setup for Windows for the Domino server is also included in their test suite.
Here is a diagram of the test automation solution the Domino team uses:
The Results
Overall, the team reduced the level of effort in executing their regression tests from more than 15 effort weeks (or 600+ hours) to 32 hours – a savings of at least 568 hours, or 95% reduction in effort. This savings allows the team to fully automate tests for the newly developed capabilities as soon as they are ready, and those tests are incorporated into the overall regression test suites.
About the company
HCL DevOps Test belongs to the Secure DevOps product domain of HCLSoftware which is a division of HCL Technologies (HCL) that operates its primary software Business. It develops, market, sells and support more than 20 product families in the areas of Secure DevOps, Automation, Digital Solutions, Data Management, Marketing and Commerce, and Mainframes.
Share on
Related Capabilities
Business & Industry Applications
Robust business applications designed to set a new benchmark in organizational efficiency. Encompassing marketing, e-commerce, value chain, and behavioral insights.
Learn more
AI and Intelligent Operations
AI and automation combined with simplicity, security and ease of use — empowering you to make informed decisions, predict market trends and enhance agility and efficiency to an unprecedented degree.
Learn more
Total Experience
TX software that interconnects the best to solve the most complex challenges organizations face, incorporating customer experience (CX), employee experience (EX), user experience (UX) and multi-experience (MX).
Learn more
Data and Analytics
The tools you need to distill complex data into clear, actionable insights — to predict outcomes, profile customers, optimize operations and identify new opportunities through data patterns and market analysis.
Learn more
Cybersecurity
Vulnerability detection, mitigation and remediation solutions that deliver secure DevOps and compliance from application to endpoint.
Learn more
- ${title}${badge}