ML Model Improvement & Management using MLOps
90% Improvement In ML Model Run Time Using MLOps
Business Challenges
The customer is a leading multinational CPG company that produces health, hygiene, and nutrition products. They used the pricing and promotion model as an essential part of their sales strategy to attract potential customers. However, the model ran in only one country, and migrating it to multiple geographies was a huge challenge.
The company also missed business deadlines because of the long model run cycle. Moreover, the model was failing for multiple SKUs across retailers because of varying data. The customer also faced technical challenges such as poor prediction quality of the model, and huge time to model training that took up to 8 days to run. Some of the other challenges were:
- High cost of infrastructure for every model run
- Zero test coverage
- Non-scalable codes
Sigmoid Solution
Sigmoid developed a solution using MLOps that reduced the time to train the model and automated the model training. In this first phase, Sigmoid developed a test suite and automated model deployment and testing to improve the prediction outcomes.
In the next phase, we created benchmarking suites to check for model improvements and efficiently handle errors to further improve the performance.
In the last phase, model features were improved by identifying the ones that were failing and working with the machine learning team to create a rule-based approach to fix them. After the final rounds of testing, models were migrated to multiple countries in a consistent and unified way.
Business Impact
The new solution brought scalability and standardization and enabled the migration of the model across geographies to create a unified approach.
8 Days to 14 hours
reduction in model run time
87%
reduction in cost per run
20%
improvement in MAPE
