PinSage: A new graph convolutional neural network for web-scale recommender systems

Deep learning methods have achieved unprecedented performance on a broad range of machine learning and artificial intelligence tasks like visual recognition, speech recognition and machine translation. However, despite amazing progress, deep learning research has mainly focused on data defined on Euclidean domains, such…

How Pinterest runs Kafka at scale

Pinterest runs one of the largest Kafka deployments in the cloud. We use Apache Kafka extensively as a message bus to transport data and to power real-time streaming services, ultimately helping more than 250 million Pinners around the world discover and do what…

Managing Videos on Android

Video launched on the Pinterest Android app in 2016 with the goal of bringing a seamless video experience to the app. This included the ability to support multiple videos per screen, while dynamically controlling their playback state by automatically pausing them when they’ve scrolled…

Empowering Pinterest data scientists and machine learning engineers with PySpark

Data scientists and machine learning engineers at Pinterest found themselves hitting major challenges with existing tools. Hive and Presto were readily accessible tools for large scale data transformations, but complex logic…

Contextual relevance in ads ranking

Pinterest runs an ads marketplace that balances value for Pinners, partners, and the business. We initially used engagement prediction as our main method to balance the marketplace before eventually adding contextual relevance to increase Pinner value. We have three main surfaces for determining…

Virtual onboarding in the time of COVID-19: The new hire’s new normal

Cindy Xinyi Zhang | Data Scientist, Experimentation and Metrics Science On March 2nd, exactly one week before my full-time position at Pinterest started…

Introducing Pinqueue3.0, Pinterest’s next-gen content moderation platform

In 2016, we reached a milestone of launching Pinqueue2.0, which has since become the go-to content moderation tool for the engineering, community, and data science teams. One of our top priorities at Pinterest is fostering a safe and trustworthy experience for all…

The top Pinterest Engineering blog posts of 2018

The most-read posts of the year Three-day no-meeting schedule for engineers A one year PWA retrospective Supporting React Native How Pinterest runs Kafka at scale How switching our domain structure unlocked international growth PinSage: A new graph convolutional neural network for web-scale recommender systems Looking inside the technology that powers Pinterest Building a more inclusive way to search Building a real-time user action counting system for ads Goku: Building a scalable and high performant time series database system We’ll be back in 2019 with more updates from the team. Happy New Year!

User state-based notification volume optimization

Notifications play an important role in helping Pinterest’s 335M+ monthly active users discover and engage with inspiring content. It’s crucial to send the right number of notifications with high quality content. If we send too few notifications, Pinners might miss out on great opportunities…

Hybrid Search: Building a textual and visual discovery experience at Pinterest

As a visual discovery engine, Pinterest helps you discover ideas even when you don’t know what you’re looking for, or have the words to describe it. Using a mix of technology (including visual search) and community input (thanks to the 175B+ Pins…

User retention at Pinterest: tackling an ambiguous problem

User retention is an important but nebulous idea. It’s hard to acquire users and even harder to help them feel at home through an engaging and relevant experience. So when some of those users start to leave the platform, your first thought is…

Shallow Mirror

Henry Cai | Software Engineer, Data Engineering Pinterest uses Kafka as the backbone for data transportation. As a part of our infrastructure, Kafka MirrorMaker v1 is used to replicate traffic among different Kafka clusters spread across multiple regions. Kafka MirrorMaker is a powerful tool to replicate/aggregate data between different Kafka…

Supporting React Native at Pinterest

Early last year, a small group of engineers started investigating the possibility of adopting React Native at Pinterest. We’ve been following the ecosystem with interest since it was first open-sourced in 2015. Since then, a robust community has developed around it, and it’s been…

How switching our domain structure unlocked international growth

More than half of the 200 million monthly active users on Pinterest use our app outside the U.S. As we continue to make Pinterest even better for our global users, we moved our traffic to country code top-level domains (ccTLDs). An example of this…

How to Review Code as a Junior Developer

“Just ask questions.” That was the piece of advice that completely changed my perspective on code reviews. I first started as a Software Engineer at Pinterest on the Shopping Partner Experience team right out of college. I focused on my personal learning by reading documentation…

La evolución de la búsqueda en Pinterest

This blog article was originally posted in English. To read the English version click here. Cuando Pinterest se lanzó por primera vez, ofrecía una nueva forma de recopilar y organizar ideas de toda la web. Sin embargo, lo que comenzó como un lugar…

HierTCN: Deep learning models for dynamic recommendations and inferring user interests

As we build a visual discovery engine, it’s crucial to understand user intent and serve relevant content through recommender systems that constantly learn from a cross-section of data to dynamically predict the next idea a Pinner will love. However, we found…

Building Expanded Targeting for Pinterest Ads

With more than 300 million people coming to Pinterest each month, Pinterest offers unique opportunities for advertisers to get their products in front of people with commercial intent. Similar to other platforms, Pinterest offers a variety of advertising targeting products¹. Advertisers can…

Detecting image similarity using Spark, LSH and TensorFlow

As a visual platform, the ability to learn from images to understand our content is important. In order to detect near-duplicate images we use the NearDup system, a Spark- and TensorFlow-based pipeline. At the core of the pipeline is a Spark implementation of batch…

The Fantastic Fixathon

Engineers at Pinterest are always focused on doing what’s best for the product, but working in a codebase that’s clean, well-maintained, and relatively bug-free transforms engineering tasks from being “just work” to enjoyable opportunities to flex our skills. We’re also enriched as engineers, both technically and otherwise, when we take…

Unifying visual embeddings for visual search at Pinterest

Throughout the years, Pinterest has launched a variety of visual search products powered by computer vision to help people discover new ideas to try and products to buy. We started in 2015 with our visual cropping tool, allowing users to search within…

Pre-Submit Integration Tests For Ads-Serving

Introduction & Background The ads-serving platform is the highest-scale, highest-complexity, and highest-velocity recommendation service at Pinterest. Our ads business is growing and expanding, and the ads engineering team is iterating quickly to continue to improve the system. Therefore, it is vital to keep the system healthy, in order…

Seven best practices for inclusive product design

At Pinterest, our mission is to help you discover and do what you love. We’re building a product for everyone, because the best Pinterest is inclusive and easily usable for people with all levels of abilities. That’s why today we’re sharing our…

Building interactive email with AMP

AMP (Accelerated Mobile Pages) is an open source technology created by Google to support fast mobile web pages. Over the years, we’ve partnered with Google and adopted AMP technology in our mobile web pages to deliver a faster, more efficient user experience. Most…

Improving HBase backup efficiency at Pinterest

Pinterest has one of the largest HBase production deployments in the industry. HBase is one of the foundational building blocks of our infrastructure and powers many of our critical services including our graph database (Zen), our general-purpose key-value store (UMS), our…