What we achieved

  • Reduce

    level of effort in executing regression tests

  • Client

    advocacy + Support Team

  • Increase

    capacity to automate tests for new features

To who

Overview

  • Part 1

    Challenge

    The HCL Domino team needed to improve their regression testing coverage and reduce the time to execute tests.

  • Part 2

    Solution

    The Domino team has an Eclipse-based RCP application, and their test automation solution leverages TestNG to implement their data-driven automation framework.

  • Part 3

    Results

    Overall, the team reduced the level of effort in executing their regression tests from more than 15 effort weeks (or 600+ hours) to 32 hours – a savings of at least 568 hours, or 95% reduction in effort.

The Challenge

The HCL Domino team needed to improve their regression testing coverage and reduce the time to execute tests. They were running all their regression tests manually, and for the existing product features, that took a team of three people more than two full weeks to execute those tests. They also had a large set of tests to validate the 16 languages that Domino supports, as well as applying fixpacks and performing upgrades.

The team had previously used Rational Functional Tester, so they were familiar with its capabilities. Unfortunately, they had some turnover on their team, and the new team members had to upskill on the HCL DevOps Test UI software. With some classroom training and recorded videos of their test automation framework from the existing team, the new team members were able to be self-sufficient with DevOps Test UI in just three weeks.

The Solution

The Domino team has an Eclipse-based RCP application, and their test automation solution leverages TestNG to implement their data-driven automation framework. All the UI objects are stored in a common repository so there is no redundancy in their scripts and maintenance becomes extremely efficient.

With the need to test on 16 different languages, the team created a single DevOps Test script that selects the language, making the tests highly reusable and easy to maintain. They also have single scripts for removing a language and replacing a language for the server language pack component.

For upgrade and fixpack tests, they support three major versions with a single test script for all upgrades that includes the logic needed for the specific upgrade. For example, they test upgrades from version 10.x to 12.x – with more than 20 possible combinations.

HCL Domino can have a single server or partition servers, and all their upgrade, fixpack, and server language pack tests support both configurations. They also test both GUI installations and silent installations for all possible combinations. Normal installation and setup for Windows for the Domino server is also included in their test suite.

Here is a diagram of the test automation solution the Domino team uses:

image-casestudy

The Results

Overall, the team reduced the level of effort in executing their regression tests from more than 15 effort weeks (or 600+ hours) to 32 hours – a savings of at least 568 hours, or 95% reduction in effort. This savings allows the team to fully automate tests for the newly developed capabilities as soon as they are ready, and those tests are incorporated into the overall regression test suites.

About the company

HCL DevOps Test belongs to the Secure DevOps product domain of HCLSoftware which is a division of HCL Technologies (HCL) that operates its primary software Business. It develops, market, sells and support more than 20 product families in the areas of Secure DevOps, Automation, Digital Solutions, Data Management, Marketing and Commerce, and Mainframes.

Related Capabilities

Enterprise Security

Security from application to endpoint. Vulnerability detection, mitigation, and remediation — before, during and after the attack.

Learn more

Digital Transformation

We fuel your DIGITAL+ economy journey with technology that transforms experiences for your customers, employees and stakeholders.

Learn more

Data, Analytics & Insights

Data fuels ambitious and smart organizations. We keep planes in the air and supply chains moving, and process billions of transactions — every day. ​

Learn more

AI & Automation

Humanizing AI to solve real-world problems is key for business growth. AI will help power intelligent decisions at the DNA level of every enterprise.

Learn more