Automated cluster management and recovery for Rocksplicator

Rocksplicator at Pinterest Rocksplicator (github) was open sourced by Pinterest one and half years ago. It was designed to solve common problems of building large-scale online stateful data systems on commodity hardware, such as RocksDB replication and request routing. Technical details about how Rocksplicator solves…

Building Pin stats

A few months back, we started building a way for businesses to create and showcase their latest and favorite content on their profiles. We also wanted to make it easier for businesses to understand how their Pins are performing. If a business can…

Knit Con through an employee’s eyes

Originally published on Tobi’s personal blog. It’s not every day I get to spend two days with my coworkers making arepas, practicing Tai chi, learning how to plate dishes, and vibing to six different DJs. Two days immersing myself in the deepest caverns of…

Adventures in big data wonderland: Going down the Pinterest Path

Have you ever started looking for plants on Pinterest, only to end up shopping for pillows instead? Ever find yourself layers of Pins deep into finding a new idea, not sure of how you got there or where you started? When Pinners are in…

How to Review Code as a Junior Developer

“Just ask questions.” That was the piece of advice that completely changed my perspective on code reviews. I first started as a Software Engineer at Pinterest on the Shopping Partner Experience team right out of college. I focused on my personal learning by reading documentation…

Pre-Submit Integration Tests For Ads-Serving

Introduction & Background The ads-serving platform is the highest-scale, highest-complexity, and highest-velocity recommendation service at Pinterest. Our ads business is growing and expanding, and the ads engineering team is iterating quickly to continue to improve the system. Therefore, it is vital to keep the system healthy, in order…

How We Protect Pinners’ Passwords

Aalaa Satti | Software Engineer Amine Kamel | Head of Production Security At Pinterest, one method by which we ensure account security is through protecting Pinners’ passwords. Passwords can be problematic for a variety of reasons, including the fact that people tend to reuse their…

En Pinterest desarrollamos compilaciones para iOS rápidas y confiables

En Pinterest nos enfocamos en ayudar a las personas a descubrir ideas inspiradoras, desde recetas para una cena, hasta productos de estilo y para el hogar que comprar y lugares a los que viajar. Para ello, es…

Real-time User Signal Serving for Feature Engineering

More than 320 million unique visitors come to Pinterest every month to discover inspiring content, which also gives advertisers a unique opportunity to get their products in front of people with commercial intent. Curation…

Building a dynamic and responsive Pinterest

In 2015, the majority of content on Pinterest was pregenerated for users prior to login. It was stored statically in HBase and served directly upon entering the service. (More details can be found in the blog post Building a smarter home feed.) …

Unifying visual embeddings for visual search at Pinterest

Throughout the years, Pinterest has launched a variety of visual search products powered by computer vision to help people discover new ideas to try and products to buy. We started in 2015 with our visual cropping tool, allowing users to search within…

Improving the Quality of Recommended Pins with Lightweight Ranking

The Pinterest corpus is composed of billions of Pins, however, each Pinner only sees a small subset based on their interests when…

The evolution of search at Pinterest

When Pinterest first launched it provided a new way for people to collect and organize ideas from around the web. What started as a place to save though, quickly became a unique service for discovery where Pinners could draw inspiration from each other, brands and…

Simplifying web deploys

Over the past six months, Pinterest has moved to a CI/CD model for our API and web layers, which has truly improved agility by reducing time between merge and production. Prior to…

Building Pin cohesion

At Pinterest, we’re building a visual discovery engine where ideas become actionable with links to more information. Once a Pin is saved, its linked content may be updated or expire over time, and so it’s critical to know…

Contextual relevance in ads ranking

Pinterest runs an ads marketplace that balances value for Pinners, partners, and the business. We initially used engagement prediction as our main method to balance the marketplace before eventually adding contextual relevance to increase Pinner value. We have three main surfaces for determining…

Pinterest + ktlint = ❤

Ha pasado casi un año desde que la base de código Android de Pinterest se convirtió en la prioridad de Kotlin, y aproximadamente dos años desde que adoptamos ktlint para el formato y lint de Kotlin. Hoy, compartimos que Pinterest se…

Shallow Mirror

Henry Cai | Software Engineer, Data Engineering Pinterest uses Kafka as the backbone for data transportation. As a part of our infrastructure, Kafka MirrorMaker v1 is used to replicate traffic among different Kafka clusters spread across multiple regions. Kafka MirrorMaker is a powerful tool to replicate/aggregate data between different Kafka…

Understanding Pins through keyword extraction

Pinterest is well known for its visual discovery engine, but much of our content is also accompanied by text. As a result, it’s important for us to be able to understand text to ensure we recommend relevant ideas to Pinners. In this blog post…

The Dead Code Society

On June 1, 2018, engineer Chris Lloyd created the #dead-code-society Slack channel to be “a sombre place for remembering [---]-only diffs.” Messages are prefixed by a :tombstone: and include links to diffs that contain only file or line deletions. The channel averages a little over one message per day, but they frequently come in bursts as part of refactoring projects and clean-up efforts. As Pinterest has grown as a company, our software unpinning has grown with it. We have hundreds of software engineers producing thousands of changes per week. The net result is an upward trend in total lines of code with a significant portion of our software having been (re)written in just the last few years. The #dead-code-society has helped balance that trend by celebrating the retirement of code from active service. Retired code remains in source control history to be remembered and consulted, but it no longer occupies a prominent place in our workspaces, build systems, or cognitive periphery. Less is more. Carpe diem.

Improving HBase backup efficiency at Pinterest

Pinterest has one of the largest HBase production deployments in the industry. HBase is one of the foundational building blocks of our infrastructure and powers many of our critical services including our graph database (Zen), our general-purpose key-value store (UMS), our…

Geo-blocking media content on Pinterest

Pinterest engineers are tasked with showing Pinners the best ideas related to their interests, which includes taking into account signals like location. As part of these efforts, we built a video and image platform to enable a…

Multi-task Learning and Calibration for Utility-based Home Feed Ranking

Home feed is one of the most important surfaces at Pinterest that drives a significant portion of engagement from the more than 400+ million people who visit each month. From a…

Driving Shopping Upsells from Pinterest Search

Pinterest’s mission is to bring everyone the inspiration to create a life they love. Shopping is at the core of Pinterest’s mission by helping Pinners find and purchase the products they like. Oftentimes when Pinners want to buy…

Developing fast & reliable iOS builds at Pinterest (Part one)

At Pinterest we’re focused on helping people discover inspiring ideas, from dinner recipes to try, home and style products to buy, to places to travel. Building the best products for mobile is a critical part of that, with 80% of all Pinners…