• Kafka Mirror Making

  Last month the team was requested to find a way to make some production data that is going through Kafka available in a development environment so it could be used by Data teams to test their models, AI agents, etc.

  Read more…

• Losing Kafka messages (largestTime=0)

  Continuing the Kafka saga. In my last post I talked about the migration problems and the investigation around the Magic Version errors. This one is about what happened after we solved those issues and finally deployed the cluster in our test environments.

  Read more…

• A magic error on Kafka

  Last month we decided to upgrade our kafka cluster. It was still running version 0.10.2 of Kafka which have undergone lots of improvements over the years. It seemed a straightforward procedure, but we had some bumps on the road that allowed us to learn some interesting things on Kafka inner workings.

  Read more…

• About The Transformation Priority Premise

  A couple weekends ago a friend and I dedicated one of our study sessions to the discussion of The Transformation Priority Premise (TPP). Both of us already had a general idea of the concept and the reasoning behind it, but neither could come up with a real world example where it would be clearly useful.

  Read more…

• My objects are aging too fast

  A couple weeks ago we were making some performance tests in a legacy java component, in preparation for a week of expected high load. We wanted to find problems that may cause the services to fail during this important period so we could be prepared and preemptively perform some mitigation actions.

  Read more…

• About system overload

  Imagine a service that takes 100ms to handle a request and for some reason it is limited to picking a single request at a time. This means the system can cope with an average throughput of 10 requests per second.

  Read more…

← →