Datadog Log Management from Zero to One

Datadog APM Trace Search from Zero to One is the first part of advanced techniques we use at Zendesk to plan capacity and keep performance characteristics of the multi-tenant system at expected levels. Response times vary between different API endpoints and customers, as the data set grows rapidly, and new…

Chaos Engineering comes to Ruby

In a micro-service environment, an unexpected service outage often comes as a surprise and when it happens it’s stressful for engineers, managers, and the clients. If you want to prepare your Ruby application for the next surprise and prevent it early then this post is for you. I will show…

A minimal Python client for talking to TensorFlow Serving

min-tfs-client is a minimal gRPC client for TensorFlow Serving that doesn’t depend on TensorFlow. TL;DR: min-tfs-client is a minimal python client for TensorFlow Serving that allows you to use serverless services (e.g. AWS Lambda) that have deployment size limits (250 Mb uncompressed, at time of writing). It works by removing TensorFlow as a dependency to create tensor protobufs for the prediction request. Feel free…

Recipes for running a successful technical book club at work

This blog post is our learnings from running technical book clubs at Zendesk for the past 2 years. In that time we have run four book clubs: Two books on functional programming languages: Clojure and Scala Reliability is very important to us so we studied the bible on Software Reliability…

How we run gamedays in Talk

While we can sometimes see our products as simply a bundle of operations with corresponding Service Level Indicators and Objectives, we also need to keep in mind the human factor responsible for maintaining these agreements. Introduction This article idea came after a 2019 EMEA SREcon talk that strongly resonated with me…

I have a problem with 1on1 questions…

1on1s can be hard. If you’re a manager you have probably seen multiple articles offering the quick fix of questions to ask your team… A 30 second online search turned up pages of articles with catchy clickbait titles like: One on One Meeting Questions Asked By Great Managers! Top 10…

Code Coverage and Xcode

Key to unit testing is code coverage…

Creating the ultimate flexibility via Container components in React

React Components / Zendesk Garden This documentation includes React components and utilities that provide visuals, keyboard-navigation, localization, and…garden.zendesk.com I wrote a Twitter thread on some of the cool stuff we’ve done that could be very useful as a starter for other people. So here’s that thread with some extra goodies, in article form. We’ve utilised a really cool pattern…

Making the most of Answer Bot: topic group visualization using t-SNE

iOS How-to — Add Adaptive constraints to support a Universal App

Device screen size (e.g iPhone or iPad) Device Orientation (portrait or landscape) Adaptation (multi-tasking on iPad) In this post, we will learn how to add NSLayoutConstraints…

Documentation: it’s more than words

Software development is as much about communication as it is about functionality. At its core, code reflects business processes and business logic. Software never exists solely in a vacuum, it is surrounded by both context and people. Tracking the history of a business and its software becomes an increasingly important…

Evaluating Apache Pulsar

Zendesk currently use Kafka, primarily for publishing of events. We are also considering publishing the state of entities to Kafka, using compacted topics to keep only the latest version of an entity. We do this already, but are considering it for much larger data sets. These compacted topics will be…

Rotational Security Interns

The internship will…

React containers, some assembly required

Previously, I’ve written about the container pattern we use in our React components in the Zendesk Garden design system. They render no UI, handle keyboard and mouse interaction, and support RTL layouts. I believe this pattern has a lot of merit but its…

How we improved the observability of a Go project

Background About a year ago, my team took over responsibility for an event driven system written in Go. One of our first steps was to understand what the application does, and how it does it. The app already had stdout logging, rollbar notifications, datadog statsd metrics, and pager alerts. The previous…

Part 2 — Zendesk Spotlight: Our Career-Changer Engineers.

Following on from Zendesk Spotlight: Our Career-Changer Engineers I received so many words of wisdom from our career-changer engineers that it was clearly worth sharing it with the world. And judging by your response to Part 1 you think so too! Here is what they had to say. Catherine Software Engineer…

Machine learning is blossoming at Zendesk

Bill and Ted’s Excellent Adventure! A Short History of Machine Learning at Zendesk We have invested heavily in ML over the past four years and we…

Inclusion — getting the basics right around communication

An investigation into Kafka Log Compaction

Background At Zendesk, we have been using Kafka in production for several years. Primarily we have been using it to distribute events between services. For example, “a ticket has been changed, and this is what changed”. We are now considering using Kafka to share entities between systems. For example, each time…

Add Some Smarts To Your Change Data Capture

As the number of your services grows, it becomes error prone and hard…

Data Catalogs, the Luxury of Choice

Maintaining Binary Compatibility in Scala

Adding Functionality to Google Pub/Sub: Queue Meta Processing

Building user confidence in machine learning products

I’m a Software Engineer on the Data Products team at Zendesk. Recently I had one of the highlights of my career — working in the team that built Answer Bot. As a front-end specialist, my focus was on crafting the best possible user experience for Zendesk customers…

10 tips for growing a globally distributed engineering team