IN
Job Description
Key Responsibilities:
- Design, implement, and support Kafka-based streaming solutions for high-throughput, low-latency workloads
- Configure and administer Kafka topics, including partitions, replication, retention, and compaction policies, in alignment with application requirements
- Maintain cluster reliability and availability through capacity planning, upgrades, patching, and proactive maintenance
- Troubleshoot production issues such as consumer lag, broker performance, partition rebalancing, and message delivery concerns
- Establish and enforce standards for naming, ACLs, quotas, and multi-tenant usage to enable safe and consistent platform adoption
- Implement monitoring and alerting for Kafka health, throughput, latency, and storage using metrics and logs
- Collaborate with engineering teams to advise on producer and consumer configurations and best practices for scalability and resilience
- Lead performance tuning across brokers and client applications, including partition strategy and batching, as well as compression settings
- Produce and maintain documentation for operational runbooks, architecture patterns, and onboarding guidelines to support consistent usage across teams
Technical Requirements:
- Technology Cloud Platform AWS Data Analytics Amazon Managed Streaming for Apache Kafka
