Senior Consultant

Core Responsibilities:

•            Kafka Platform Architecture & Ownership

•            Deep Kafka Administration & Operations (5–8 Years Required)

•            Event-Driven Architecture Strategy

•            DevOps, Automation & Platform Engineering

•            Cloud & Kubernetes Integration

•            Monitoring, Observability & Reliability Engineering

Mandatory Experience:

•            10+ years of total IT industry experience in distributed systems, middleware, or platform engineering.

•            5–8 years of hands-on Kafka administration experience in production environments.

•            Experience managing clusters with:10+ brokers, High partition counts (10K+), TB–PB scale data retention

•            Proven experience in performance tuning and incident response for high-throughput Kafka systems.

•            Deep understanding of Kafka internals: Brokers, ZooKeeper & KRaft, Producers & Consumers, ISR mechanics, Partition leadership, Kafka Connect, Schema Registry, Kafka Streams

Technical Stack Expectations:

•            Messaging & Streaming: Apache Kafka (core), Confluent Platform, MirrorMaker 2 / Cluster Linking, Kafka Connect ecosystem

•            Cloud & Infrastructure: Kubernetes (production-grade deployments), AWS and/or GCP, Infrastructure automation (Terraform / Ansible)

•            DevOps & CI/CD: GitHub / GitLab, JIRA, Argo CD, CI/CD pipeline integration

•            Scripting & Automation: Python, Shell scripting

Ideal Candidate Profile:

•            Has operated Kafka as a platform owner, not just a consumer.

•            Comfortable debugging issues at the broker JVM level.

•            Strong background in distributed systems reliability engineering.

•            Able to translate business throughput requirements into partitioning and replication strategies.

•            Confident presenting Kafka strategy to senior leadership and non-technical stakeholders.