Pinterest Flink Deployment Framework

Background At Pinterest, stream processing allows us to unlock value from real time data for pinners and partners. The Stream Processing Platform team is working on building a reliable and scalable platform to support many critical streaming applications including real-time experiment analytics…

ConsoleMe: A Central Control Plane for AWS Permissions and Access

By Curtis Castrapel, Patrick Sanders, and Hee Won Kim At AWS re:Invent 2020, we open sourced two new tools for managing multi-account AWS permissions and access. We’re very excited to bring you ConsoleMe (pronounced: kuhn-soul-mee), and its CLI utility, Weep…

Inside Connect: An Apprentice Perspective

Connect 2020 Apprentices at Airbnb HQ Hi, I’m Ale. I was a Connect 2020 Apprentice and I’m going to write a bit about my experience with the program, especially for those who are interested in applying. To learn more about the goals and structure of the Connect program, take a look at Part 1 of this…

The story of the lost commit: how to solve this mystery

It was already evening by the time the developer contacted me. The deadbeef commit patch had disappeared from the master branch. They showed me the evidence: the output from two commands. The first one was: git show deadbeef This showed changes to the file: let’s call it Page.php. The canBeEdited…

Remote Workstations for the Discerning Artists

Netflix is poised to become the world’s most prolific producer of visual effects and original animated content. To meet that demand, we need to attract the world’s best artistic talent. Artists like to work at places where they can create groundbreaking entertainment instead of worrying about getting…

Building a technology first company

Over the past few years, we have seen rise of tech companies. There are a lot of definitions of what truly is a technology company. There are also different terminologies like “tech driven”, “tech enabled” and “pure tech”. And the debate goes on… At Grofers, our vision is to be…

How Pinterest fights misinformation, hate speech, and self-harm content with machine learning

Pinterest is an inspiration network where people come for positivity and new ideas, and there’s nothing inspiring about harmful content. As a visual discovery engine with hundreds of billions of Pins…

Welcome to Dunzo Daily!

Data classes in Kotlin: how do they impact an application size

Kotlin has numerous excellent features: null safety, smart casts, string interpolation and more. However, one of its features developers love the most, I have observed, are data classes. They are so well-loved that they are often used where no data class functionality is required. In this article, with the help…

Private libraries in Android — how to manage them.

Part 1: Private libraries in Android — why you should consider it Part 2: Private libraries in Android — how to manage them In the first part of the series, we talked about the benefits of private libraries. On top…

People Behind the Product: Meet Rahim Daya, Head of International Product & Toronto Lead

Rahim Daya, Toronto-native and Pinployee of nearly 4 years, leads Pinterest’s International Product as well as the Tech team in Toronto. Ahead of our virtual Pinterest Engineering: Meet the Toronto Team event, get to know Rahim and learn more about…

A Day in the Life of an Experimentation and Causal Inference Scientist @ Netflix

Source credit: Netflix Within the rapid expansion of data-related roles in the last decade, the title Data Scientist has emerged as an umbrella term for myriad skills and areas of business focus. What does this title mean within a given company, or even within a given industry…

Inside Connect: Airbnb’s Engineering Apprenticeship Program

by Beti Gathegi & Jacqui Watts Hello! We’re excited that you’re here to learn more about the Connect program. Before we share details, though, we’d like to introduce ourselves. We’re Beti Gathegi and Jacqui Watts — a team of two whose purpose at Airbnb is to help bring this program…

The Netflix Cosmos Platform

by Frank San Miguel on behalf of the Cosmos team Introduction Cosmos is a computing platform that combines the best aspects of microservices with asynchronous workflows and serverless functions. Its sweet spot is applications that involve resource-intensive algorithms coordinated via complex, hierarchical workflows that last anywhere from minutes to years. It…

Packaging award-winning shows with award-winning technology

Introduction In previous blog posts, our colleagues at Netflix have explained how 4K video streams are optimized, how even legacy video streams are improved and more recently how new audio codecs can provide better aural experiences to our members. In all these cases, prior to being delivered through…

Fighting spam with Guardian, a real-time analytics and rules engine

As the Trust & Safety team, one of our major responsibilities is protecting Pinners from spam. Without protections, spam could potentially be all over Pinterest since spammers can script and generate activity at a rate much higher than actual users. One of…

Visualizing Data Timeliness at Airbnb

Imagine you are a business leader ready to start your day, but you wake up to find that your daily business report is empty — the data is late, so now you are blind. Over the last year, multiple teams…

Vulcan: Inventory Redistribution at Myntra

Redistribution Model: 1. Problem Statement At Myntra a section of our supply…

Beyond REST

by Dane Avilla The entertainment industry has struggled with COVID-19 restrictions impacting productions around the globe. Since early 2020, Netflix has been iteratively developing systems to provide internal stakeholders and business leaders with up-to-date tools and dashboards with the latest information on the pandemic. These software solutions allow executive leadership…

How we designed our Continuous Integration System to be more than 50% Faster

Earlier this year, the Engineering Productivity team at Pinterest published a blog called How a one line change decreased our clone times by 99%. In that post, we described how a simple Git configuration sped up clone times in one of our…

Convert a Universal (FAT) Framework to an XCFramework

Background Strava consumes various third party frameworks via Carthage to power our application. These frameworks are either built from an Xcode project stored in a Github repository (Carthage’s github directive in the Cartfile) or distributed as prebuilt artifacts (Carthage’s binary directive in the Cartfile). The binary dependencies are typically distributed as…

Building a Rule-Based Platform to Manage Netflix Membership SKUs at Scale

At Netflix, we aspire to entertain the world. From mailing DVDs in the US to a global streaming service with over 200 million subscribers across 190 countries, we have come a long way. For the longest time, Netflix had three plans (basic/standard/premium)…

Updating Kubernetes CA certificates the hard way

So buckle up; it might be a bumpy ride! The hard way yes, but automated! At Deezer, Kubernetes has…

Hawkins: Diving into the Reasoning Behind our Design System

by Hawkins team member Joshua Godi; with cover art from Martin Bekerman and additional imagery from Wiki Chaves Hawkins may be the name of a fictional town in Indiana, most widely known as the backdrop for one of Netflix’s most popular TV series “Stranger Things,” but the name is so…

Supercharging Apache Superset

By: Erik Ritter, Grace Guo, Jesse Yang, John Bodley, and Zuzana Vejrazkova Introduction At Airbnb, many employees rely on data every day to do their jobs. While several different tools are used for analysis, at the core of Airbnb’s self-serve business intelligence (BI) solution is Apache Superset™ (“Superset”). Superset is…