Reusability as a pattern: from copy-pasting to components

Bumble is developing several applications (i.e: Badoo and Bumble) and each one of them is a separate product with its own features, management, product and engineering teams. However, we all work together in the same office and solve similar problems. Nevertheless, projects have diverged greatly during development. The codebase was…

Grofers Lambda: A 2019 Year-In-Review

The most-read authors, stories, and what’s coming in 2020. In 2019, we increased our focus on Lambda with an aim to share stories that give you an insider look into the tech and people that run Grofers. As a result, 2019 turned out to be an incredible year of learning for all of us at Grofers engineering. Best? our…

Using graph algorithms to optimize Kafka operations, Part 1

Pinterest uses Kafka across the board for data movement. The Logging Platform team alone manages over 3,000 Kafka brokers transporting trillions of messages per day to help bring more than 320 million monthly active Pinners the inspiration to create a life they love. …

Informal relationships

Many years ago I joined a company as a developer and soon witnessed something odd. Another department’s teamlead called up one of his subordinates in the middle of the day and told him: ‘Here, come and get this money and go to a store and grab me some drinks and…

Volcanic piglet, or do-it-yourself SQL

Collecting, storing and transforming data — these are the main tasks of a data engineer. In any one 24-hour period, Bumble Business Intelligence unit receives and processes over 30 billion events sent from clients’ devices or application servers. Researching and interpreting all this data are not trivial tasks; sometimes it…

Powering Pinterest ads analytics with Apache Druid

The Change When we launched Promoted Pins in 2014, we chose Apache HBase as our database to store and serve all of our reporting metrics. At the beginning of our ads business, this was an appropriate choice because…

20 Flavors to Try in 2020

It’s a new decade — and the year is off to a sweet (and spicy, crispy, oh-so toasty, meaty) okay, let’s just say — flavorful start. Here, we’ve compiled our top 20 food trends to try in the new year. It’s…

Empowering Local Economies in 2019

1001 ways to code your projects, 1 way to meet your needs

Have you ever noticed that there are about 1001 ways to do something, especially in software development? As I tell every developer who joins my team, especially interns or junior devs, no one knows everything and every solution should be considered. I was recently confronted with 1001 ways of doing…

Popeyes is now on DoorDash — Get a free* Chicken Sandwich to celebrate

This morning, we launched a partnership with POPEYES® across 1,000 locations to bring their fan-favorites and classics to customers’ doorsteps nationwide. Crunchy chicken, chicken tenders, fried shrimp, biscuits, and that famous Chicken Sandwich, all delivered where you want them, when you…

Better Android Testing at Airbnb

In previous articles we’ve looked at Airbnb’s product architecture, the mocking system we built for it, and how this ecosystem…

Interest Taxonomy: A knowledge graph management system for content understanding at Pinterest

Interest Taxonomy at Pinterest We recently began rolling out the beta version of Pinterest Trends, a new tool that gives a view of the top U.S. search terms on Pinterest within the past 12 months, and a look into when search terms peak for…

Get Your Product The Attention It Deserves

Design by Asif Jamal It’s Christmas time. You’re walking down that crowded market street. After having saved money for a long time, you’re now hunting for presents for your loved ones. You have narrowed down your idea of a gift and have decided to get them the best sweaters in town. Your friend tells you of a…

Announcing a New Partnership with Chase

Prometheus at Prezi: replacing 10 years of anti-patterns

What happens when you combine 10 years of architectural organic build-up and a lack of common best practices around monitoring? Bad on-call shifts, more outages, longer outages and a lack of technical flexibility. In our effort towards uniformity and reliability, we redesigned our entire monitoring stack and created a new…

Do You Need A Personal OKR?

Design by Asif Jamal Making a contract with your future self When we started using OKRs in Grofers, it was to ensure that we had a way of getting everyone on the same page around what was important towards our goals as a team and as a company. This exercise taught us a lot and although we’ve failed in every…

10 tips for growing a globally distributed engineering team

Better Android Testing at Airbnb

In the previous article we detailed our test framework implementation. This was a high level look at the approach we take to running our tests…

How I Work: Devika Razdan

At Grofers, we have some of the smartest people who collaborate to do great work. Over the years, these individuals have crafted their own systems and tools for productivity and in this series, we share how they excel using the systems, methods, and tools that work for them. Over the…

Better Android Testing at Airbnb

In previous installments of this series we laid out our state mocking system, and how we built UI integration testing on top of it. In…

Routing for iOS: universal navigation without rewriting the app

What’s wrong with navigation anyway? Almost every app has a navigation between different internal components and it seems like it shouldn’t be a problem. UIKit contains more or less convenient containers like UINavigationController, UITabBarController and a flexible way to present screens modally. We, as developers, just need to use the right tools. However, as soon…

How ads indexing works at Pinterest

Introduction Ads indexing is a data processing pipeline that builds servable ad documents for the ads delivering stack at Pinterest, including ads targeting, retrieval, ranking and auction. The pipeline converts ad campaigns in the raw format to the servable format via a heavy computational…

Mutation Testing in PHP: quality measurement for code coverage

How do you evaluate how good your tests are? Many people rely on the most popular score, the one everyone knows — code coverage. But this is a quantitative, rather than a qualitative metric. It shows how much of your code is covered by the tests, but not how well…

Designers, Good Designers, And Great Designers

To design is to solve a problem. And we solve problems all day long! Does that make everyone a designer? Got into a fight with your partner? Here are some possible solutions: Shout and scream until you explode Bring them flowers Whip yourself a hundred times in an act of self-flagellation Write a card Buy them a present Stop talking and hope they forget about it (my favourite), etc. Finally…

DBLog: A Generic Change-Data-Capture Framework

Overview Change-Data-Capture (CDC) allows capturing committed changes from a database in real-time and propagating those changes to downstream consumers [1][2]. CDC is becoming increasingly popular for use cases that require keeping multiple heterogeneous datastores in sync (like MySQL and ElasticSearch) and addresses challenges that exist with traditional…