Case Study
Transforming Test Automation For A Leading Educational Organization
Discover how FireFlink solved test automation challenges for an education firm—handling database checks, chatbot automation using NLP, network analysis, and even game automation.
Transformation Summary
FireFlink enhanced test automation for a leading educational platform by simplifying database validations, chatbot testing, network analysis, and game automation, boosting application stability and testing efficiency at scale.
Problem Statement
This private organization epitome of excellence in terms of providing detailed & quality education all available at the user’s fingertips. With its video-based learning content, the organization has gained nearly 23 million active users consuming its materials. The organization has web & mobile-based applications with constantly evolving content for all age groups. Their catalog of study materials ranges from pre-schooling to even providing legitimate support to cracking the reputed competitive exams. The organization was even listed in the Time 100 Most influential companies.
Testing Implementation
As the organization mainly functioned as an educational technology pattern, they had web & mobile applications that were heavily utilized for pretty much their entire daily operations. They faced some major roadblocks while carrying out tests, particularly on their applications. As the bulk operation was, study content intake from their end users, they had an immense quantity of data that was uploaded for constant usage. With this, they had a requirement to carry out test automation that was pointing to their database, at a scheduled time interval for all of their active databases. The application had an integrated chatbot which was used frequently by candidates when they came across any doubts or queries while undergoing their course of study. Test automation was expected for the various test scenarios around the chatbot. Chatbot automation is challenging and time intensive as the testing units were following outdated and complicated automation techniques. Since the application had users from all parts of the world, their base audience varied, and education on the go, or uninterrupted learning was aimed. Even if the user were in a low network zone, Streaming must not be halted. The user needed a test automation solution around the networking aspect. There were also simple games that were incorporated for users of certain age groups to interact and visually learn while playing challenging games. A well-organized simplified test automation strategy was needed to carry out game automation.
FireFlink Solution
Having collaborated with multiple organizations of similar domains, FireFlink thoroughly supported the organization with its test automation challenges. Since the application had an influx of new educational sessions, constantly push in, as most of the videos have transformed into knowledge-on-demand centers of excellence. We encountered the need of verifying the database and verify if the sessions are pushed in on time and are reflex on the UI as well as the database. FireFlink showcased an in-house solution where the database tests consistently FireFlink has NLP (Natural Language Processing) automation steps that are ready to use. We made use of the already in-place chatbot NLPs which help us automate chatbots from in and around the applications for both their web & mobile-based applications. Users are even allowed to maintain a test data document fed with all possible queries a student might come across and carry out data-driven tests for more accurate & focused automation tests. With FireFlink, users can easily understand the stability of their applications in multiple ways. One of the many ways is to understand the trend of test results from the analytics section. A test engineer could easily understand the network fluctuations or analyze script failures due to the internet or low latencies. Detailed configurations are provided within the platform which dives to the root cause of any test failure. Test scenarios as tricky as game automation were carried out as a part of the automation project. The application had calculation-dependent, learning-oriented games for early learners. With the overall coverage of 95% of any possible automation need (action/verifications) NLPs within FireFlink were exclusively used for test automation of all games on the applications.