Scaling Kubernetes with Assurance at Pinterest

Introduction It has been more than a year since we shared our Kubernetes Journey at Pinterest. Since then, we have delivered many features to facilitate customer adoption, ensure reliability and scalability, and build up operational experience and best practices. In general, Kubernetes platform users gave…

Improving HBase backup efficiency at Pinterest

Pinterest has one of the largest HBase production deployments in the industry. HBase is one of the foundational building blocks of our infrastructure and powers many of our critical services including our graph database (Zen), our general-purpose key-value store (UMS), our…

How Pinterest Supercharged its Growth Team With Experiment Idea Review

Growth teams need to be organized bottom-up to scale well The Pinterest Growth team has over 100 members, and we’ve run thousands of experiments over the years. It’s difficult to run that many experiments and still maintain a high success rate over time. We’ve found the traditional growth team model of team leads…

How we built rearranging Pins

Listening to user feedback is essential to building a product Pinners love and use to discover and save ideas every day. Often, their feature requests present interesting technical challenges for our engineers. For example, today we launched the ability to…

Faster Creator Content Distribution at Pinterest

At Pinterest, we are committed to building the best experience for creators to reach and inspire new audiences and for Pinners to easily discover the best ideas for them. We believe more diverse Pin formats and an efficient distribution system that builds a…

Refactoring Thrift schemas at Pinterest

The Pinterest tech stack consists of hundreds of microservices written in a variety of languages that use Apache Thrift to communicate with each other. Thrift schemas are used to define our service interfaces, constants and serialized data across all levels of the stack…

What we learned from an iOS app OOMs incident

In early 2020, we started seeing significantly elevated out-of-memory (OOM) crashes in the Pinterest iOS app. That incident resulted in a declined Crash-Free Users Rate (CFUR), from the previous 99% to 96%, which was a steep drop. What was going on? We improved…

User state-based notification volume optimization

Notifications play an important role in helping Pinterest’s 335M+ monthly active users discover and engage with inspiring content. It’s crucial to send the right number of notifications with high quality content. If we send too few notifications, Pinners might miss out on great opportunities…

How switching our domain structure unlocked international growth

More than half of the 200 million monthly active users on Pinterest use our app outside the U.S. As we continue to make Pinterest even better for our global users, we moved our traffic to country code top-level domains (ccTLDs). An example of this…

Multi-task Learning and Calibration for Utility-based Home Feed Ranking

Home feed is one of the most important surfaces at Pinterest that drives a significant portion of engagement from the more than 400+ million people who visit each month. From a…

Contextual relevance in ads ranking

Pinterest runs an ads marketplace that balances value for Pinners, partners, and the business. We initially used engagement prediction as our main method to balance the marketplace before eventually adding contextual relevance to increase Pinner value. We have three main surfaces for determining…

Pre-Submit Integration Tests For Ads-Serving

Introduction & Background The ads-serving platform is the highest-scale, highest-complexity, and highest-velocity recommendation service at Pinterest. Our ads business is growing and expanding, and the ads engineering team is iterating quickly to continue to improve the system. Therefore, it is vital to keep the system healthy, in order…

One year in at Pinterest and looking ahead as we grow

A little over a year ago, I joined Pinterest as the SVP of Technology. The world looks different than I thought it would around my first “Pinniversary”, but the opportunities before us are more apparent and abundant than ever before. For me personally, I’m…

PinText: A Multitask Text Embedding System in Pinterest

Word embeddings have been actively studied and developed by researchers and practitioners in the machine learning community since the neural network language model was proposed. Researchers not only proposed principled algorithms and open-source code, but they also released pre-trained embedding models with public…

Managing Videos on Android

Video launched on the Pinterest Android app in 2016 with the goal of bringing a seamless video experience to the app. This included the ability to support multiple videos per screen, while dynamically controlling their playback state by automatically pausing them when they’ve scrolled…

Building the Pinterest app for Windows 10

Solving a user problem As we focus on developing ways to help Pinners find inspiration across all interests, locations and platforms, we knew we had to improve the experience for Windows. Accessing Pinterest from desktop requires using a browser, often times with numerous tabs…

The Dead Code Society

On June 1, 2018, engineer Chris Lloyd created the #dead-code-society Slack channel to be “a sombre place for remembering [---]-only diffs.” Messages are prefixed by a :tombstone: and include links to diffs that contain only file or line deletions. The channel averages a little over one message per day, but they frequently come in bursts as part of refactoring projects and clean-up efforts. As Pinterest has grown as a company, our software unpinning has grown with it. We have hundreds of software engineers producing thousands of changes per week. The net result is an upward trend in total lines of code with a significant portion of our software having been (re)written in just the last few years. The #dead-code-society has helped balance that trend by celebrating the retirement of code from active service. Retired code remains in source control history to be remembered and consulted, but it no longer occupies a prominent place in our workspaces, build systems, or cognitive periphery. Less is more. Carpe diem.

Four lessons in making Pinterest faster on Android

As engineers, we intuitively know that a faster app is a better experience for Pinners, but we also have proof that when web pages load faster, user growth improves. Last year, we doubled down on performance across our platforms so…

An update on Pixie, Pinterest’s recommendation system

We recently welcomed engineers to our offices for our annual Mad Science Fair, where I shared the latest on Pixie, an advanced graph-based recommendation system. Here’s a recap of that talk, and you can find the video here. As Pinterest grows to more…

Growth engineering meetup

Synopsis of the talks Paid growth @ Airbnb Ganesh Venkataraman discusses the various channels and techniques…

API Profiling at Pinterest

When I walked into Pinterest on the first day of my internship and learned I’d be focusing on profiling the API Gateway service — the core backend service of the Pinterest product — my only thought was “What is profiling?”. Profiling is often shoved aside…

How we designed our Continuous Integration System to be more than 50% Faster

Earlier this year, the Engineering Productivity team at Pinterest published a blog called How a one line change decreased our clone times by 99%. In that post, we described how a simple Git configuration sped up clone times in one of our…

Interest Taxonomy: A knowledge graph management system for content understanding at Pinterest

Interest Taxonomy at Pinterest We recently began rolling out the beta version of Pinterest Trends, a new tool that gives a view of the top U.S. search terms on Pinterest within the past 12 months, and a look into when search terms peak for…

Understanding Pins through keyword extraction

Pinterest is well known for its visual discovery engine, but much of our content is also accompanied by text. As a result, it’s important for us to be able to understand text to ensure we recommend relevant ideas to Pinners. In this blog post…

Building Pin stats

A few months back, we started building a way for businesses to create and showcase their latest and favorite content on their profiles. We also wanted to make it easier for businesses to understand how their Pins are performing. If a business can…