Case Study
Accelerating Releases And Enhancing Quality For A Leading OTT Service
FireFlink revolutionized test automation for the leading OTT platform, simplifying user content understanding, multi-language UI, concurrent content watching, and Android TV testing. Find out how FireFlink improved their testing process. Read on.
Transformation Summary
FireFlink enhanced quality assurance for a leading OTT service by automating content recommendation workflows, simplifying multilingual testing, and validating synchronized streaming and collaboration features across web, mobile, and smart TV platforms.
Problem Statement
The organization is a leading name in over-the-top (OTT) services which is a direct-to-consumer video streaming platform. The platform has content in 12 different languages that are available over the web, android, iOS, and smart TVs, among other devices. The platform has millions of active users. The organization has multiple applications where users can record and upload their videos and can also view and engage with the videos shared by other people. Depending on the device, the application supports up to 4K (UHD) and high-dynamic-range (HDR) streaming.
Testing Implementation
The customer has always aimed for excellence and the product has a reputation for understanding the user and providing customized suggestions based on the user’s likes and content engagement. For such a platform, the customer faced vital issues concerning the software when it was under test The Media & Entertainment industry has seen a seismic shift with the content development, engagement, and distribution models being developed to meet the progressive commercial that is in accordance with their interests. The customer needed a test automation solution using which they could study the content intake of the user, based on their search history so that the team could customize the content suggestions. The customer also had a major challenge dealing with the massive UI element repository they maintained for the 12 different language options they provided for the users. Separate sets of automation scripts were written to perform test automation for different language variations. The customer needed a simple solution to avoid repetition while writing automation test scripts. Evaluate a user's ability to concurrently watch content in sync with that of another user while simultaneously participating in chat conversations taking place on the same platform. The customer also needed solutions to check how their application functioned on Android television sets for which test automation is fairly challenging.
FireFlink Solution
FireFlink understood the customer’s test automation concerns and provided one-of-a-kind solutions that simplified test automation for the organization for its various applications. For understanding the user and their pattern of engagement with the platform, we carried out automation tests in FireFlink. A plan was derived to keep a check on the UI, carry out the tests, and compare it to the database. Meaning, the actual search log was monitored through the UI for which automation tests were crafted additionally, scripts were also written to fetch data from the database through test automation. The entire line-up was carried out from a single automation script channel. Test maintainability is a vital standard of test automation within FireFlink. To make sure we provided a solution for script redundancy, team FireFlink made use of a readily-available functionality where automation scripts were created just once for repetitive use. There is a functionality for creating a UI element set. Meaning, during the execution stage, a user can make an entirely different set of UI elements on which the automation scripts will be running. This technique does not hamper the execution duration and users can create as many UI element sets as needed without having to re-write automation test scripts. The customer had an extraordinary feature where multiple users can view content in sync while collaborating/chatting with each other. As a test automation solution, FireFlink derived several end-to-end test scenarios around it and carried out API test automation & API validations all by using simplified in-built functionalities. With FireFlink, test engineers are also enabled to perform Android TV test automation. As a synopsis, we were able to automate end-to-end flows of Android TV operations along with scripting for mobile and computer devices all from a single script channel.