A Day in Release Engineering at Grofers

This post touches up facets of what release engineering is at Grofers and what the life of an engineer on this team looks like. After reading this, one should get an idea about why it is important to us, what is an engineer supposed to do to support the team…

How I Work: Devika Razdan

At Grofers, we have some of the smartest people who collaborate to do great work. Over the years, these individuals have crafted their own systems and tools for productivity and in this series, we share how they excel using the systems, methods, and tools that work for them. Over the…

Personal Staging Environment for Micro-Services Architecture

Grofers has been following micro-services architecture for a while now. While there are plenty of advantages…

Origins of Data Lake at Grofers

Design by Asif Jamal The Beginning As Data Engineers at the biggest online grocery company in India, one of our major challenges is to democratize data across the organization. But, when we began evaluating how well we were doing on this goal, we realized that frequent errors in our data pipelines had caused our business teams…

Managing key-values in Consul using ConsulKV CRD

We have been deploying applications on Kubernetes for over two years. We mostly followed a lift-and-shift approach while migrating to Kubernetes. We looked for everything that Ansible used to do for us and tried to replicate it in Kubernetes. At first, everything seemed to work. But over time we realized…

How I Started Working With Kubernetes

Animation by Asif Jamal I first heard about Kubernetes in 2016. When Docker was the new boom, Kubernetes was introduced as a prototype system to manage containers. Though I was unsure of getting into it, I passed it at that time as I was content with containers and didn’t need any orchestration. However, when…

Community Update — March 2019 (Bangalore)

Ansible at Grofers (Part 1) — Introduction

About a year ago, we started setting up our infrastructure platform to make daily system operations and infrastructure maintenance easy and enable our developers in a way that they can move faster. This post is part one of a series on how we use Ansible at Grofers…

Making Grocery Shopping Faster on Web

We released Grofers’ web platform about two months back. This post describes a few performance improvements that we have achieved in recent times. Background To bring about more user engagement and open the most straightforward user acquisition channel, we released our web platform to make it possible for…

Software Engineering Internship at Grofers

Internships are a training ground for the professional “real world”. What exactly does the “real world” entail? How disjoint is it from what we learn at university? Am I equipped enough to step into this simulation of the…

Iris — Merchant Discovery at Grofers

A, C, and E are the visible merchants Each merchant in our system has the following characteristics: Merchant location Merchant serviceability distance (i.e. places where the merchant delivers) As soon as the user opens the consumer app, the user location gets fired. We consider a list of…

How Grofers Doubled The VIP Pass Purchase Conversion For India’s Biggest Grocery Sale

The GOBD sale. The e-commerce sector in India continues to grow rapidly with major peaks around the holiday period. Sometimes a good ol’ sale will give you a baseline jump faster than any new product initiative on a fixed scale of time. Making the sale big therefore is of paramount importance. At Grofers…

Ansible at Grofers (Part 4) — Manageable auto-scaling with Ansible

Auto-Scaling Groups (ASG) in AWS EC2 provide a really easy way to scale your services horizontally based on different kinds of alarms. It launches instances using existing AMIs baked by you for your services. While ASGs are easy to understand at a high level, they have their own challenges —…

Community Update: Announcing Grofers Tech Talks!

…

How COVID-19 pushed us to reduce our AWS cost by half

We have been extremely focused on growth before COVID started. AWS is central to how we ship fast that helps fuel that growth. Some of our early mistakes resulted in wastage resulting in high costs over time. COVID-19 pushed us to bring more efficiency in our business operations to provide…

Building a technology first company

Over the past few years, we have seen rise of tech companies. There are a lot of definitions of what truly is a technology company. There are also different terminologies like “tech driven”, “tech enabled” and “pure tech”. And the debate goes on… At Grofers, our vision is to be…

React Native at Grofers: Using React Native components inside native views

Horizontal scrolling widget has been built in…

How we load tested our APIs in Production

Grofers’ microservices based infrastructure currently handles around 400K Daily Active Users(DAU). One of the goals of the engineering team this quarter is to make sure our servers are robust enough to handle load at 2.5X of this number i.e. 1 million DAUs. Both availability and performance of our APIs are…

Adopting Tekton — Cloud Native CI Solution

We have been exploring Tekton as a CI platform recently for office and off-office work. So I thought to share all my findings with you. Tekton is a powerful yet flexible, Kubernetes-native open-source framework for creating continuous integration and continuous delivery (CI/CD) systems. But before we proceed, let’s see what…

CPU Throttling in Kubernetes: A Postmortem

Kubernetes is a crucial part of our infrastructure. We don’t just deploy applications on Kubernetes in production, but we also use it heavily for our CI/CD and developer infrastructure. While developing our CI/CD infrastructure, we dealt with a particular performance issue of our dev and CI environments taking up a…

Anomaly detection using Isolation forest

A crazy, wild, roller-coaster ride

It was towards the end of October 2014 that I came to know about Grofers. A friend of mine had…

Application Server Optimization

For the past few weeks, I have been working on improving our system. The improvements involve metrics related to latency. In this article, I am sharing some recipes that I found helpful in my work. This article will be Python-Django specific. I think it should be generally…

How to use your private NPM packages with Docker on CI

Our team recently came across a strange issue where one of our application was failing to build after we installed another internal library as a dependency to this app. This was very strange as we were able to get it working on our local machines and the only thing separating…

How We Sustain DNS Outages at Grofers

Design by Asif Jamal Cloudflare is one of the most popular DNS and CDN service provider currently used by over 16 million internet sites. Every day, these sites utilize Cloudflare’s services for performance enhancement, DDoS mitigation, and more. We do too. So when Cloudflare suffered multiple outages, it affected websites around the globe. And…