When a customer cannot buy a service or upgrade a device online, they switch. For a large Canadian telecom, a flawless eCommerce and self-serve experience was the difference between keeping customers and losing them.
“In a high-churn market, a broken buy flow is not a bug. It is a lost customer.”
A large Canadian telecom needed to guarantee a seamless Browse, Buy, and Self-Serve experience across web and mobile. With thousands of use cases, edge scenarios, and multiple languages to support across Android, iOS, and web, the effort was overwhelming and no automation was in place. Every failed journey meant lost opportunity and lost revenue.
ML arteka deployed robotic test automation using UXPLORE to continuously test the production environment, mimicking thousands of buy and self-serve flows. Using a flexible testing-as-a-service model, the team automated over 1200 cases for nightly testing across desktop, tablet, and mobile, on Internet Explorer, Firefox, Chrome, and Safari, and integrated the tool with the client’s JIRA to report defects automatically.
The result: 99% uptime through parallel testing, 85% fewer testing resources, more than 100 critical defects caught and reported, and over 1200 flows automated across 12 platforms.
Business Outcomes
Proactive, continuous testing turned a manual, people-based process into a resilient, always-on quality engine.
Through parallel testing of user journeys.
Labour and resources required for testing.
Across desktop, tablet, and mobile platforms.
The Transformation
From a manual, people-based process to continuous, unattended production testing.
- 1
AssessMap the Journeys That MatterIdentified the Browse, Buy, and Self-Serve flows across web and mobile, and the 1200-plus use cases, edge scenarios, and languages that had to work. - 2
AutomateRobotic Test Automation with UXPLOREAutomated over 1200 cases for nightly, unattended testing that mimics real buy and self-serve flows in production. - 3
ScaleTest Everywhere, Every NightRan the same journeys across desktop and mobile browsers on Windows, Mac, iPad, iPhone, and Android, for consistent coverage. - 4
Close the LoopAutomatic Defect ReportingIntegrated with the client’s JIRA so defects were logged automatically, then triaged and assigned for fix and redeploy.
The Business Challenge
When Growth Outpaces Manual Testing
Rather than react to customer issues, the telecom wanted to get ahead of them, but had no automation and an overwhelming test surface.
Multiple applications
Browse, Buy, and Self-Serve all needed testing across web and mobile.
People-based process
Testing was entirely manual, with no automation in place.
Multiple platforms
Android, iOS, web, and mobile views all had to be covered.
Too many use cases
Features and journeys added up to more than 1200 cases.
Business Outcomes in Detail
What the Numbers Mean
Through parallel testing of user journeys.
Labour and resources required for testing.
Across desktop, tablet, and mobile platforms.
Technology Snapshot
The Automation Stack
Proactive testing changes the economics of quality. Instead of choosing between efficiency and simplicity, the telecom got both: an always-on safety net that protects revenue while its teams focus on building, not firefighting.
Executive Questions and Answers
The questions leadership tends to ask when evaluating an approach like this.
Coverage
How do you test 1200 cases every night without a huge team?
Robotic automation runs the journeys unattended across 12 platforms in parallel, so coverage scales without a proportional increase in people.
Reliability
Why test in production rather than only in staging?
Continuously mimicking real buy and self-serve flows in production catches issues customers would actually hit, which is what protects revenue in a high-churn market.
Speed
How quickly are defects acted on?
Defects are reported automatically into JIRA, then triaged and assigned to developers to fix and redeploy, closing the loop fast.
