Zendesk ML Model Building Pipeline on AWS Batch: Monitoring and Load Testing

The series started with Wai Chee Yau’s exploration of AWS Batch and why we ended up choosing it…

Reverse engineering Sketch’s resizing functionality

My first mission has been diving into the world of rendering our react components back into Sketch, a design tool, to keep the final components in sync. Standing on the shoulders of others, I have…

How probable are collisions with ULID’s monotonic option?

There’s a lot of excitement at Zendesk about ULID. As a universally unique identifier format, ULID has become a popular alternative to UUID in recent years. For most of our history at Zendesk, we’ve used integer IDs internally for database keys, as well as in our public APIs. We even…

Running a team colocation — The beginning of something great

What will we leave behind?

…

The history of infrastructure at Zendesk (Part 1) — constant tradeoffs

Collecting Build Metrics from Buddybuild

So after a long hiatus from writing, I’ve decided to try and be a bit more disciplined and write more frequently. This is the first in a series around how we have introduced build time tracking across our CI environments, and how we track it in our development tools. We…

Documentation: it’s more than words

Software development is as much about communication as it is about functionality. At its core, code reflects business processes and business logic. Software never exists solely in a vacuum, it is surrounded by both context and people. Tracking the history of a business and its software becomes an increasingly important…

Zendesk’s Global Mesh Network- Part 1

Kafka on Ruby

SwiftUI & UIView — A Simple Mistake

I recently made a simple mistake. An implementation which appeared correct, based on its initial usage, turned out to be incorrect when its usage changed. But before we start, although this post describes the mistake I made and shows you how…

A minimal Python client for talking to TensorFlow Serving

min-tfs-client is a minimal gRPC client for TensorFlow Serving that doesn’t depend on TensorFlow. TL;DR: min-tfs-client is a minimal python client for TensorFlow Serving that allows you to use serverless services (e.g. AWS Lambda) that have deployment size limits (250 Mb uncompressed, at time of writing). It works by removing TensorFlow as a dependency to create tensor protobufs for the prediction request. Feel free…

Code Coverage and Xcode

Key to unit testing is code coverage…

Rotational Security Interns

The internship will…

Part 2 — Zendesk Spotlight: Our Career-Changer Engineers.

Following on from Zendesk Spotlight: Our Career-Changer Engineers I received so many words of wisdom from our career-changer engineers that it was clearly worth sharing it with the world. And judging by your response to Part 1 you think so too! Here is what they had to say. Catherine Software Engineer…

Create a test data generator using Kafka Connect

…

Running a team colocation — The TL;DR

NO to over-planning, YES to #COLOYOLO Don’t over-plan and take it easy! Make it a working week, don’t try to overload it with meetings. Just remember…

App Onboarding with SwiftUI

Onboarding is the process of helping users to understand an app, and hopefully, encouraging them to continue to use it. Onboarding flows usually consist of one or more screens explaining how a user can use the app, and often involve some input from the user, e.g signing up, logging in…

Making the most of Answer Bot: topic group visualization using t-SNE

A Github Actions Workflow to Generate & Publish your Hugo Website

This short post describes a Github Actions workflow to generate your Hugo-based website and publish it to Github Pages. To learn more about Hugo and GitHub Pages, and how to use them to build your website, see my previous post. What is Github Actions Github Actions is a service from Github which allows you…

How we run gamedays in Talk

While we can sometimes see our products as simply a bundle of operations with corresponding Service Level Indicators and Objectives, we also need to keep in mind the human factor responsible for maintaining these agreements. Introduction This article idea came after a 2019 EMEA SREcon talk that strongly resonated with me…

Say Hi to Delivery Boy!

Hot off the heels of releasing Racecar, our easy-to-use framework for running Kafka consumers in Ruby, we’re ready to release yet another Kafka-related library! This time, it’s all about message delivery. Up until now, if you wanted to produce messages to Kafka from a Rails application, you’d need to write…

The Dawn of Zendesk’s Machine Learning Model Building Platform with AWS Batch

This article focuses on the new model…

Let’s make a message encoder in Ruby

Binary message encoding is a common pattern in modern distributed systems. Tools like Protobuf, Avro and Thrift are increasingly used to decrease payload size and provide typed contracts for message produces and consumers. Many developers will need to utilise these tools at some point, but they can be opaque and…

Datadog Log Management from Zero to One

Datadog APM Trace Search from Zero to One is the first part of advanced techniques we use at Zendesk to plan capacity and keep performance characteristics of the multi-tenant system at expected levels. Response times vary between different API endpoints and customers, as the data set grows rapidly, and new…