Volcanic piglet, or do-it-yourself SQL

Collecting, storing and transforming data — these are the main tasks of a data engineer. In any one 24-hour period, Bumble Business Intelligence unit receives and processes over 30 billion events sent from clients’ devices or application servers. Researching and interpreting all this data are not trivial tasks; sometimes it…

Optimising relational databases with zero downtime

A case study of Badoo’s most loaded database Optimising relational databases is much harder in high-load circumstances: buying an even more powerful hardware is expensive, and one cannot just turn off the app at night to alter the database and migrate data. In this article I would like to tell you how we completely changed the inner structure…

Implementing the Netflix Media Database

Why physical storage of your database tables might matter

In our quest to simplify and enrich online grocery shopping for our users, we experimented with serving personalized item recommendations to each one of them. For this we operated in batch mode and pre computed relevant top 200 item recommendations for each user and dumped the results in a table…