PinSage: A new graph convolutional neural network for web-scale recommender systems

Deep learning methods have achieved unprecedented performance on a broad range of machine learning and artificial intelligence tasks like visual recognition, speech recognition and machine translation. However, despite amazing progress, deep learning research has mainly focused on data defined on Euclidean domains, such…

How to Review Code as a Junior Developer

“Just ask questions.” That was the piece of advice that completely changed my perspective on code reviews. I first started as a Software Engineer at Pinterest on the Shopping Partner Experience team right out of college. I focused on my personal learning by reading documentation…

Using Kafka to throttle QPS on MySQL shards in bulk write APIs

At Pinterest, backend core services are in charge of various operations on pins, boards, and users from both Pinners and internal services. While Pinners’ operations are identified as online traffic because of real-time response, internal traffic is identified as offline because processing is…

How Pinterest runs Traffic-based Interlinking experiments for SEO

Search Engine Optimization, or SEO, is an important channel for people to find ideas and inspiration on Pinterest, and can also help expose new users to first use cases, such as hairstyle tutorials or a home office setup. …

Goku: Building a scalable and high performant time series database system

Co-authored by Jinghan Xu, Jian Wang & Tian-Ying Chang, Engineers At Pinterest, developers rely on Statsboard to monitor their systems and discover issues. A reliable and efficient monitoring system is very important for development velocity. Historically, we’ve used OpenTSDB to ingest and…

Building Expanded Targeting for Pinterest Ads

With more than 300 million people coming to Pinterest each month, Pinterest offers unique opportunities for advertisers to get their products in front of people with commercial intent. Similar to other platforms, Pinterest offers a variety of advertising targeting products¹. Advertisers can…

Building the Pinterest app for Windows 10

Solving a user problem As we focus on developing ways to help Pinners find inspiration across all interests, locations and platforms, we knew we had to improve the experience for Windows. Accessing Pinterest from desktop requires using a browser, often times with numerous tabs…

Empowering Pinterest data scientists and machine learning engineers with PySpark

Data scientists and machine learning engineers at Pinterest found themselves hitting major challenges with existing tools. Hive and Presto were readily accessible tools for large scale data transformations, but complex logic…

How we designed our Continuous Integration System to be more than 50% Faster

Earlier this year, the Engineering Productivity team at Pinterest published a blog called How a one line change decreased our clone times by 99%. In that post, we described how a simple Git configuration sped up clone times in one of our…

API Profiling at Pinterest

When I walked into Pinterest on the first day of my internship and learned I’d be focusing on profiling the API Gateway service — the core backend service of the Pinterest product — my only thought was “What is profiling?”. Profiling is often shoved aside…

Setting Up Snowflake Secondary Roles with Tableau

At Pinterest, we heavily utilize Tableau for our enterprise analytics. In an effort to secure access of sensitive data to the appropriate business units, we moved the enterprise data into a Snowflake data warehouse. Using Snowflake as a data platform, we can create and manage…

Simplifying web deploys

Over the past six months, Pinterest has moved to a CI/CD model for our API and web layers, which has truly improved agility by reducing time between merge and production. Prior to…

Shallow Mirror

Henry Cai | Software Engineer, Data Engineering Pinterest uses Kafka as the backbone for data transportation. As a part of our infrastructure, Kafka MirrorMaker v1 is used to replicate traffic among different Kafka clusters spread across multiple regions. Kafka MirrorMaker is a powerful tool to replicate/aggregate data between different Kafka…

User retention at Pinterest: tackling an ambiguous problem

User retention is an important but nebulous idea. It’s hard to acquire users and even harder to help them feel at home through an engaging and relevant experience. So when some of those users start to leave the platform, your first thought is…

La evolución de la búsqueda en Pinterest

This blog article was originally posted in English. To read the English version click here. Cuando Pinterest se lanzó por primera vez, ofrecía una nueva forma de recopilar y organizar ideas de toda la web. Sin embargo, lo que comenzó como un lugar…

Detecting image similarity using Spark, LSH and TensorFlow

As a visual platform, the ability to learn from images to understand our content is important. In order to detect near-duplicate images we use the NearDup system, a Spark- and TensorFlow-based pipeline. At the core of the pipeline is a Spark implementation of batch…

Launching your career as an apprentice engineer at Pinterest

In 2018, after more than a decade focused on environmental sustainability, I decided to start a new career as a software engineer. I enrolled in an immersive software development course in NYC, and a year later I was headed to a software engineering apprenticeship…

How we increased engagement using automatic personalized copy testing

Think about the last time you visited a website. Was there a word that helped draw you in? Now think about how that might be different if you spoke a different language, were a different age or grew up in a different part of…

A Pinterest Engineering guide to technical interviews

Technical interviews are the key component to landing an engineering role. Everything from preparation to asking the right questions is important for a successful interview. In this post, Pinterest employees from Recruiting and Engineering share tips and tricks for…

Pin it to Win it: Our First Virtual Pinternship

When our University Recruitment team started planning for the 2020 Pinterns to arrive, our goal was to welcome them to Pinterest and provide them with a memorable experience. As the pandemic quickly changed everyone’s plans, this core goal remained the same and we adapted our strategy to accommodate the…

The Dead Code Society

On June 1, 2018, engineer Chris Lloyd created the #dead-code-society Slack channel to be “a sombre place for remembering [---]-only diffs.” Messages are prefixed by a :tombstone: and include links to diffs that contain only file or line deletions. The channel averages a little over one message per day, but they frequently come in bursts as part of refactoring projects and clean-up efforts. As Pinterest has grown as a company, our software unpinning has grown with it. We have hundreds of software engineers producing thousands of changes per week. The net result is an upward trend in total lines of code with a significant portion of our software having been (re)written in just the last few years. The #dead-code-society has helped balance that trend by celebrating the retirement of code from active service. Retired code remains in source control history to be remembered and consulted, but it no longer occupies a prominent place in our workspaces, build systems, or cognitive periphery. Less is more. Carpe diem.

En Pinterest desarrollamos compilaciones para iOS rápidas y confiables

En Pinterest nos enfocamos en ayudar a las personas a descubrir ideas inspiradoras, desde recetas para una cena, hasta productos de estilo y para el hogar que comprar y lugares a los que viajar. Para ello, es…

Adventures in big data wonderland: Going down the Pinterest Path

Have you ever started looking for plants on Pinterest, only to end up shopping for pillows instead? Ever find yourself layers of Pins deep into finding a new idea, not sure of how you got there or where you started? When Pinners are in…

How switching our domain structure unlocked international growth

More than half of the 200 million monthly active users on Pinterest use our app outside the U.S. As we continue to make Pinterest even better for our global users, we moved our traffic to country code top-level domains (ccTLDs). An example of this…

The top Pinterest Engineering blog posts of 2018

The most-read posts of the year Three-day no-meeting schedule for engineers A one year PWA retrospective Supporting React Native How Pinterest runs Kafka at scale How switching our domain structure unlocked international growth PinSage: A new graph convolutional neural network for web-scale recommender systems Looking inside the technology that powers Pinterest Building a more inclusive way to search Building a real-time user action counting system for ads Goku: Building a scalable and high performant time series database system We’ll be back in 2019 with more updates from the team. Happy New Year!