CPU Throttling in Kubernetes: A Postmortem

Kubernetes is a crucial part of our infrastructure. We don’t just deploy applications on Kubernetes in production, but we also use it heavily for our CI/CD and developer infrastructure. While developing our CI/CD infrastructure, we dealt with a particular performance issue of our dev and CI environments taking up a…

Application Server Optimization

For the past few weeks, I have been working on improving our system. The improvements involve metrics related to latency. In this article, I am sharing some recipes that I found helpful in my work. This article will be Python-Django specific. I think it should be generally…

A crazy, wild, roller-coaster ride

It was towards the end of October 2014 that I came to know about Grofers. A friend of mine had…

Community Update — March 2019 (Gurgaon)

For the Golang track, community member Ishaan Bahal talked about GRPC and its use cases from the ground up…

Evolving Continuous Delivery in a Cloud-Native Environment

Launch quickly, inspect closely, iterate rapidly

Exploratory Data Analysis of orders on Grofers

Securing AWS Access Keys

After a Friday night party, we found out that someone had accidentally put AWS Access Keys in a public repository (thanks to AWS Security Team for reporting this). Keys didn’t have much access and were of a test environment, but this could have happened with any other key pair with…

Show and Tell S02E01

API Management at Grofers with Kong

As we scaled up our backend at Grofers, we moved from a monolithic service to a microservice architecture. Our monolithic service was written to handle tasks like authentication and rate limiting as a part of its code base. When we started to set up various microservices we…

Building Personalisation at Scale

I have talked about how we have been building a technology first company in my previous post. Taking this further, I am back with the next level of innovation we have been doing to make our customer journey as satisfying as its for us to serve them! At Grofers, our…

Ansible at Grofers (Part 4) — Manageable auto-scaling with Ansible

Auto-Scaling Groups (ASG) in AWS EC2 provide a really easy way to scale your services horizontally based on different kinds of alarms. It launches instances using existing AMIs baked by you for your services. While ASGs are easy to understand at a high level, they have their own challenges —…

React Native at Grofers: Using React Native components inside native views

Horizontal scrolling widget has been built in…

A Day in Release Engineering at Grofers

This post touches up facets of what release engineering is at Grofers and what the life of an engineer on this team looks like. After reading this, one should get an idea about why it is important to us, what is an engineer supposed to do to support the team…

Software Engineering Internship at Grofers

Internships are a training ground for the professional “real world”. What exactly does the “real world” entail? How disjoint is it from what we learn at university? Am I equipped enough to step into this simulation of the…

How to use your private NPM packages with Docker on CI

Our team recently came across a strange issue where one of our application was failing to build after we installed another internal library as a dependency to this app. This was very strange as we were able to get it working on our local machines and the only thing separating…

A Comprehensive Guide To Deploying A Website In Kubernetes

Recently, we at Grofers took a decision to migrate all our services to Kubernetes. Now during the process of migrating our frontend website to Kubernetes, we realised that the default Rolling Update deployment strategy doesn’t work that well and we had to shift to Blue Green strategy instead (we’ll go…

Reducing AWS data transfer cost: Kubernetes from Multi-AZ to Single-AZ

The only silver lining for us during COVID-19 was that we got a chance to optimize our resources in our run to cut costs — a long-pending activity. All the teams across the organization were focused on reducing the operating costs as much as possible. Similarly, DevOps teams were mainly…

Making Grocery Shopping Faster on Web

We released Grofers’ web platform about two months back. This post describes a few performance improvements that we have achieved in recent times. Background To bring about more user engagement and open the most straightforward user acquisition channel, we released our web platform to make it possible for…

On Setting Up Our AWS VPC

TL;DR: This blog post is about the choices we made while trying to organize our infrastructure resources in AWS VPC and automating everything around it. Our Infrastructure So Far Since we signed up on AWS fairly recently, we were given a VPC by default. We used to launch EC2 instances seamlessly…

Community Development @ Grofers

Photo taken at a meetup we hosted. This upcoming Saturday(October 27th), we will be hosting meetups themed around Android, Python, and Kubernetes. This will be a great day to come by the office and chat with the people that built Grofers. Be sure to bring your laptop(someplace to put all the stickers.)

Anomaly detection using Isolation forest

Origins of Data Lake at Grofers

Design by Asif Jamal The Beginning As Data Engineers at the biggest online grocery company in India, one of our major challenges is to democratize data across the organization. But, when we began evaluating how well we were doing on this goal, we realized that frequent errors in our data pipelines had caused our business teams…

5 not-so-basic basic guidelines to become a mediocre UX/UI/Product designer.

1. Don’t fall in love with your solutions. Fall in love with the problem. Reference to pop culture. Check. Nothing is written in stone. Especially your…

Why physical storage of your database tables might matter

In our quest to simplify and enrich online grocery shopping for our users, we experimented with serving personalized item recommendations to each one of them. For this we operated in batch mode and pre computed relevant top 200 item recommendations for each user and dumped the results in a table…