How not to screw up when scaling processing from 1 country to 33

Talk video

How did we scale data processing with tens of machine learning models, working only for the Ukrainian market, in 33 countries?

  • Splitted monoliths, responsible for queue management and intellectual processing, to independent microservices
  • Unified codebase for individual data processing algorithms in different countries
  • Got rid off queues in mysql
  • Automated services deploy
  • Set up services discovery
  • Integrated load testing
  • Made reliable processing of thousands of events per day
Danil Topchiy
LUN
  • Software engineer at LUN
  • National Technical University of Ukraine "Igor Sikorsky Kyiv Polytechnic Institute" graduate
  • Develops data processing in LUN
  • Loves to bring beautiful technical solutions to perfection
  • Hosting a podcast about technologies
  • Facebook
Sign in
Or by mail
Sign in
Or by mail
Register with email
Register with email
Forgot password?