Using machine learning to auto-organize boards

While planning one’s life might look different these days, our insights tell us people are saving ideas for the future more than ever. Last month, for instance, Pinterest had a 60% increase in the number…

Refactoring Thrift schemas at Pinterest

The Pinterest tech stack consists of hundreds of microservices written in a variety of languages that use Apache Thrift to communicate with each other. Thrift schemas are used to define our service interfaces, constants and serialized data across all levels of the stack…

API Profiling at Pinterest

When I walked into Pinterest on the first day of my internship and learned I’d be focusing on profiling the API Gateway service — the core backend service of the Pinterest product — my only thought was “What is profiling?”. Profiling is often shoved aside…

Real-time User Signal Serving for Feature Engineering

More than 320 million unique visitors come to Pinterest every month to discover inspiring content, which also gives advertisers a unique opportunity to get their products in front of people with commercial intent. Curation…

Faster Creator Content Distribution at Pinterest

At Pinterest, we are committed to building the best experience for creators to reach and inspire new audiences and for Pinners to easily discover the best ideas for them. We believe more diverse Pin formats and an efficient distribution system that builds a…

What we learned from an iOS app OOMs incident

In early 2020, we started seeing significantly elevated out-of-memory (OOM) crashes in the Pinterest iOS app. That incident resulted in a declined Crash-Free Users Rate (CFUR), from the previous 99% to 96%, which was a steep drop. What was going on? We improved…

Geo-blocking media content on Pinterest

Pinterest engineers are tasked with showing Pinners the best ideas related to their interests, which includes taking into account signals like location. As part of these efforts, we built a video and image platform to enable a…

Using Kafka to throttle QPS on MySQL shards in bulk write APIs

At Pinterest, backend core services are in charge of various operations on pins, boards, and users from both Pinners and internal services. While Pinners’ operations are identified as online traffic because of real-time response, internal traffic is identified as offline because processing is…

How we reduced Pinterest’s iOS app size by 30+% / 50MB

We all know app size (download size[1] and local install size[2]) matters, and there is a correlation between app size and customer engagement. Many times, people make decisions about using software based on size, and even pay for bandwidth by the megabyte. Not…

User state-based notification volume optimization

Notifications play an important role in helping Pinterest’s 335M+ monthly active users discover and engage with inspiring content. It’s crucial to send the right number of notifications with high quality content. If we send too few notifications, Pinners might miss out on great opportunities…

Secret management in multi-tenant environments

Knox, Pinterest’s open-source secret management service, now supports SPIFFE x509 identity documents as an authentication method. This update enables Knox to manage secrets in multi-tenant environments like Kubernetes. Knox is widely used across Pinterest’s infrastructure to provision secrets into production systems. In an…

Building interactive email with AMP

AMP (Accelerated Mobile Pages) is an open source technology created by Google to support fast mobile web pages. Over the years, we’ve partnered with Google and adopted AMP technology in our mobile web pages to deliver a faster, more efficient user experience. Most…

Building a universal search system for Pinterest

On Pinterest, the best answer goes beyond text, but can even go beyond an image too. When you’re looking for eye makeup ideas for example, a video personalized to your skin tone range teaching you how to create a certain look is likely…

Cómo redujimos el tamaño de la aplicación de Pinterest para iOS en más de un 30% / 50 MB

This blog was originally published in English. To read the English version, click here. Todos sabemos que el tamaño de las aplicaciones es importante (el tamaño de descarga[1] y el tamaño de instalación local[2]). Además, existe una correlación…

Knit Con through an employee’s eyes

Originally published on Tobi’s personal blog. It’s not every day I get to spend two days with my coworkers making arepas, practicing Tai chi, learning how to plate dishes, and vibing to six different DJs. Two days immersing myself in the deepest caverns of…

El fantástico Fixathon

Los ingenieros de Pinterest siempre están enfocados en hacer lo mejor para el producto, pero trabajar en una base de código limpia, con buen mantenimiento y relativamente libre de errores transforma las tareas de ingeniería de ser “solo trabajo” a oportunidades agradables para…

Scaling Kubernetes with Assurance at Pinterest

Introduction It has been more than a year since we shared our Kubernetes Journey at Pinterest. Since then, we have delivered many features to facilitate customer adoption, ensure reliability and scalability, and build up operational experience and best practices. In general, Kubernetes platform users gave…

A one year PWA retrospective

The idea of building a “Progressive Web App” (PWA) is not new, but its definition has changed with the emergence of key technologies like service workers. Now it’s finally possible to build great experiences in a mobile browser. Being an early adopter can…

The top Pinterest Engineering blog posts of 2018

The most-read posts of the year Three-day no-meeting schedule for engineers A one year PWA retrospective Supporting React Native How Pinterest runs Kafka at scale How switching our domain structure unlocked international growth PinSage: A new graph convolutional neural network for web-scale recommender systems Looking inside the technology that powers Pinterest Building a more inclusive way to search Building a real-time user action counting system for ads Goku: Building a scalable and high performant time series database system We’ll be back in 2019 with more updates from the team. Happy New Year!

Goku: Building a scalable and high performant time series database system

Co-authored by Jinghan Xu, Jian Wang & Tian-Ying Chang, Engineers At Pinterest, developers rely on Statsboard to monitor their systems and discover issues. A reliable and efficient monitoring system is very important for development velocity. Historically, we’ve used OpenTSDB to ingest and…

Using graph algorithms to optimize Kafka operations, Part 1

Pinterest uses Kafka across the board for data movement. The Logging Platform team alone manages over 3,000 Kafka brokers transporting trillions of messages per day to help bring more than 320 million monthly active Pinners the inspiration to create a life they love. …

Four lessons in making Pinterest faster on Android

As engineers, we intuitively know that a faster app is a better experience for Pinners, but we also have proof that when web pages load faster, user growth improves. Last year, we doubled down on performance across our platforms so…

Ad Metrics Quality and Testing on Mobile

Every day at Pinterest, we help our advertising partners reach Pinners through different ad formats, and we provide them with metrics and analytics on how their ads are performing. Maintaining our partners’ trust and delivering value is critical, so the metrics we expose…

En Pinterest desarrollamos compilaciones para iOS rápidas y confiables

En Pinterest nos enfocamos en ayudar a las personas a descubrir ideas inspiradoras, desde recetas para una cena, hasta productos de estilo y para el hogar que comprar y lugares a los que viajar. Para ello, es…

Pinterest Flink Deployment Framework

Background At Pinterest, stream processing allows us to unlock value from real time data for pinners and partners. The Stream Processing Platform team is working on building a reliable and scalable platform to support many critical streaming applications including real-time experiment analytics…