With hundreds of devices and dozens of browsers, compatibility is a moving target, and for an app used by millions, every unproven device is a broken experience waiting to happen.
“Great experiences are not designed once. They are proven on every device, every release.”
The client wanted their upcoming eCommerce and self-serve application to be compatible with 99% of the devices in the market. Testing manually on each device required device availability and a considerable investment in people to conduct end-to-end testing across browsers and platforms.
ML arteka provided Test Automation-as-a-Service for creation and execution, developing JavaScript test cases with WebdriverIO and the Jasmine framework and integrating them into a Jenkins CI/CD pipeline running on SauceLabs. Using Selenium WebdriverIO, the same test could run across multiple desktop and mobile browsers hosted in the cloud, rather than writing a separate case per browser.
The result: a 50% increase in test coverage, 10x savings on regression time and resources, a 5x improvement in test efficiency, and cloud devices that cut hardware maintenance cost.
Business Outcomes
Cloud-based, reusable tests turned device fragmentation into a scalable, low-cost coverage model.
Through CI/CD.
Time and resources.
Same tests across more devices.
The Transformation
From device-by-device manual testing to cloud-based continuous coverage.
- 1
ServiceTest Automation-as-a-ServiceDelivered test creation and execution as a service so the client did not need in-house remote-device expertise. - 2
BuildWrite Once, Run EverywhereDeveloped JavaScript cases with WebdriverIO and Jasmine so a single test runs across many desktop and mobile browsers. - 3
CloudRemote Devices with SauceLabsRan tests on cloud-hosted devices, removing the need to acquire and maintain physical hardware. - 4
IntegrateImmediate Feedback via JenkinsIntegrated testing into Jenkins pipelines for continuous, immediate feedback on every change.
The Business Challenge
Proving Compatibility Across a Fragmented Market
Dozens of browsers and hundreds of devices, and a client without remote-device testing expertise.
Multiple platforms
Different browsers and devices across iOS and Android needed testing.
Complex flows
Many variations required extensive manual regression on web and mobile.
Remote device testing
Needed, but the client lacked the in-house expertise.
Business Outcomes in Detail
What the Numbers Mean
Through CI/CD.
Time and resources.
Same tests across more devices.
Technology Snapshot
The Cloud Testing Stack
Compatibility is not a one-time certification. By designing tests to run once across many cloud devices, the client can keep proving 99% coverage as new devices appear, without buying a single one.
Executive Questions and Answers
The questions leadership tends to ask when evaluating an approach like this.
Coverage
How do you reach 99% device compatibility affordably?
By running the same tests across cloud-hosted devices on SauceLabs, coverage scales without acquiring physical hardware for every device and browser combination.
Efficiency
How is a 5x efficiency gain possible?
Tests are designed so one case runs across multiple desktop and mobile browsers, rather than a separate case per browser, which multiplies coverage per test written.
Scale
What happens when new devices launch?
New devices are added on the cloud platform, so the client gains greater stability today and can extend coverage in the future without buying devices.
