I have a problem with 1on1 questions…

1on1s can be hard. If you’re a manager you have probably seen multiple articles offering the quick fix of questions to ask your team… A 30 second online search turned up pages of articles with catchy clickbait titles like: One on One Meeting Questions Asked By Great Managers! Top 10…

Data store migrations with no downtime

Data store migrations can be complex, especially if the application cannot afford to have maintenance downtime. We will explore some strategies that can help you navigate the complexity. In our case, it was a migration from a NoSQL data store, DynamoDB into a relational data store, MySQL. However, this post…

Zendesk ML Model Building Pipeline on AWS Batch: Monitoring and Load Testing

The series started with Wai Chee Yau’s exploration of AWS Batch and why we ended up choosing it…

The Dawn of Zendesk’s Machine Learning Model Building Platform with AWS Batch

This article focuses on the new model…

Inclusion — getting the basics right around communication

Creating the ultimate flexibility via Container components in React

React Components / Zendesk Garden This documentation includes React components and utilities that provide visuals, keyboard-navigation, localization, and…garden.zendesk.com I wrote a Twitter thread on some of the cool stuff we’ve done that could be very useful as a starter for other people. So here’s that thread with some extra goodies, in article form. We’ve utilised a really cool pattern…

Running a team colocation — The beginning of something great

Leading Machine Learning at Zendesk

I recently participated in an interview series covering careers in emerging technology fields on the French website TOM.travel. I’ve been leading machine learning at Zendesk for the last 6 years and over that time we’ve grown from two people in Melbourne to tens of people on three continents. I discussed…

Composable Go

With a lot of languages, it is easy to replace a given function or method call with a mocked version. Dynamically replacing or statically injecting mocked dependencies makes testing code much easier. Personally I’ve found this approach less than ideal in Go, so I’ve been looking for another way to…

An investigation into Kafka Log Compaction

Background At Zendesk, we have been using Kafka in production for several years. Primarily we have been using it to distribute events between services. For example, “a ticket has been changed, and this is what changed”. We are now considering using Kafka to share entities between systems. For example, each time…

Foldable Go

Create a test data generator using Kafka Connect

…

How we use AWS Batch at Zendesk to Build All The Machine Learning Models

In this instalment, I’ll be describing…

10 tips for growing a globally distributed engineering team

Sorbet: Type annotations for Ruby

Maintaining Binary Compatibility in Scala

Having better One-on-Ones

1:1s are often my…

Zendesk Spotlight: Our Career-Changer Engineers.

(Part One) Zendesk Engineering in Melbourne is growing, and growing fast. Four years ago we had five engineering teams and now there is somewhere in the vicinity of thirty. One of the pillars of this rapid growth has been the hiring of career changers — folks who have decided to shift their…

Zendesk’s Global Mesh Network- Part 1

Blameless Culture

Open sourcing node-publisher

The dependency graph of our hypothetical package “A” We’ve just fixed an annoying bug in dependency C and our task is to propagate the fix up until package A. So…

Evaluating Apache Pulsar

Zendesk currently use Kafka, primarily for publishing of events. We are also considering publishing the state of entities to Kafka, using compacted topics to keep only the latest version of an entity. We do this already, but are considering it for much larger data sets. These compacted topics will be…

Racecar v2: A New Foundation

It’s been three years since we introduced Racecar, a simple framework for building Kafka consumer applications that worked seamlessly with or without Ruby on Rails. With Racecar, building a consumer application for processing…

Building user confidence in machine learning products

I’m a Software Engineer on the Data Products team at Zendesk. Recently I had one of the highlights of my career — working in the team that built Answer Bot. As a front-end specialist, my focus was on crafting the best possible user experience for Zendesk customers…

The history of infrastructure at Zendesk (Part 2) — the messy middle