Implementing mTLS and Securing Apache Kafka at Zendesk

This article was originally posted on the Confluent blog at https://www.confluent.io/blog/how-zendesk-secures-kafka-with-mtls-authentication-system/ Background At Zendesk, Apache Kafka® is one of our foundational services for distributing events among different internal systems. We have pods, which can be thought of as isolated cloud environments where our products run, spread out all across the world…

Code Coverage and Xcode

Key to unit testing is code coverage…

Reverse engineering Sketch’s resizing functionality

My first mission has been diving into the world of rendering our react components back into Sketch, a design tool, to keep the final components in sync. Standing on the shoulders of others, I have…

Zendesk Spotlight: Our Career-Changer Engineers.

(Part One) Zendesk Engineering in Melbourne is growing, and growing fast. Four years ago we had five engineering teams and now there is somewhere in the vicinity of thirty. One of the pillars of this rapid growth has been the hiring of career changers — folks who have decided to shift their…

Datadog App Analytics/Logs from One to N

The science behind consolidating Answer Bot production Models: Part 1

At Zendesk, we believe that great customer service builds strong customer relationships and that Machine Learning ( ML ) can play a powerful role in creating good customer experiences. Whether it is enhancing search tools or powering entire self-service systems, ML has the…

Hunting for Memory Leaks in Python applications

Going Where our Team has not Gone Before

How to plan out where you’re going when you don’t know how you’re going to get there. Organising a data science team’s research direction is a challenge in itself and there’s no algorithm with which to optimise it. This quarter our team is trying something new. Generally when our data…

React containers, some assembly required

Previously, I’ve written about the container pattern we use in our React components in the Zendesk Garden design system. They render no UI, handle keyboard and mouse interaction, and support RTL layouts. I believe this pattern has a lot of merit but its…

Xcode 10’s build system and Code Generation (R.swift)

R.swift is an open source library which makes it both easier and type-safe to use resources such as images, fonts, and segues. It’s a really cool library, and we have used it successfully at Zendesk for quite a while now. However… The Problem When building a project which uses R.swift with Xcode 10, the build will fail with the following error: error: Build input file cannot be found: /LOCATION/R.generated.swift Why This Happens R.swift is integrated into projects using an Xcode build script phase. This phase generates a Swift file, R.generated.swift, which is compiled when the project is built. The build fails because Xcode 10, with its new parallelizing build system, is trying to locate the R.generated.swift file before it has been created. The Solution Xcode 10 allows us to specify an output file for a build script phase. We can add our R.generated.swift file as an output file as follows: Adding our R.generated.swift file as an output file in our Xcode build script phase This results in a successful build. Awesome! 🎉 Additional When we encountered this initially, we opened a bug with R.swift. However, as shown above, the issue is due to changes in Xcode’s build system. That’s it! 📱🚀👍🏽 Also available on petethedeveloper.com

Xcode Quick Tip – Testing your layout for localization

Recently we encountered buggy UI component positioning when the device language was changed from the default language (English). This is shown below with Dutch. UI component (UISwitch) incorrectly positioned due to ambiguous constraints Due…

Running a team colocation — The beginning of something great

The Joys of Circuit Breaking

Zendesk’s product suite is built with an evolving service oriented architecture, comprising hundreds of micro services and a growing web of interdependencies. Operating and orchestrating such a large scale distributed system can be challenging. This post will explore the importance of circuit breaking and related concepts. A few weeks ago…

Create a test data generator using Kafka Connect

…

Zendesk’s Global Mesh Network- Part 1

Data Catalogs, the Luxury of Choice

Zendesk’s journey to Kubernetes

We can use Kubernetes for little things, but there isn’t much point doing it for our original monolithic Ruby on Rails product. Even if we did…

Performing Kubernetes Service CIDR Block Migration

History At Zendesk, we started our Kubernetes journey in September 2015, shortly after version 1.0 was publicly available. At the time of v1.0 not much information was available and we didn’t have a lot of experience, so some configuration choices that made sense four years ago have had to be reconsidered…

An investigation into Kafka Log Compaction

Background At Zendesk, we have been using Kafka in production for several years. Primarily we have been using it to distribute events between services. For example, “a ticket has been changed, and this is what changed”. We are now considering using Kafka to share entities between systems. For example, each time…

10 tips for growing a globally distributed engineering team

Chaos Engineering comes to Ruby

In a micro-service environment, an unexpected service outage often comes as a surprise and when it happens it’s stressful for engineers, managers, and the clients. If you want to prepare your Ruby application for the next surprise and prevent it early then this post is for you. I will show…

Running a team colocation — The TL;DR

NO to over-planning, YES to #COLOYOLO Don’t over-plan and take it easy! Make it a working week, don’t try to overload it with meetings. Just remember…

Kafka on Ruby

A Beginners Guide to Deploys and Releases

The process of releasing software to users at scale is one that can be particularly confusing for new software engineers, as most don’t have exposure to this part of the software development process until their first internship or job. I found this to be the case during my time at…

Making the most of Answer Bot: topic group visualization using t-SNE