IN
Job Description
Job Description:
- Join a team where reliable data movement powers real business outcomes
- In this role you ll help run and evolve a high availability streaming platform that enables real time integrations analytics and event driven applications across the organization
- You ll work closely with engineers platform teams and stakeholders to keep Kafka environments stable secure and scalable while continuously improving performance and operational excellence
- If you enjoy troubleshooting complex distributed systems automating repetitive tasks and building strong monitoring and governance practices this is a great opportunity to grow your impact
- You ll be encouraged to bring ideas collaborate openly and take ownership of platform health ensuring teams can confidently publish and consume data streams at scale
Key Responsibilities:
- Key Responsibilities
- Administer and support Kafka clusters ensuring high availability reliability and performance across environments
- Perform Kafka broker provisioning configuration upgrades patching and capacity planning aligned to platform standards
- Manage topics partitions replication factors retention policies quotas and ACLs based on application needs and governance guidelines
- Monitor cluster health and performance analyze metrics logs and proactively address bottlenecks latency throughput ISR issues
- Troubleshoot production incidents perform root cause analysis and drive corrective and preventive actions
- Support Confluent components as applicable e
- g
- Schema Registry Kafka Connect and ensure smooth integration with client teams
- Implement and maintain security controls including authentication authorization and secure configurations for data in motion
- Automate operational tasks and standardize runbooks alerts and operational procedures to improve platform efficiency
- Collaborate with application teams on onboarding best practices and performance tuning for producers consumers
- Maintain documentation for architecture configurations operational processes and change management activities
Technical Requirements:
- Primary skills Technology Cloud Platform AWS Data Analytics Amazon Managed Streaming for Apache Kafka
Additional Responsibilities:
- Minimum Qualifications
- Bachelor s degree or equivalent in Engineering Computer Science IT BTech BE MCA MSc or similar
- 3 5 years of overall experience with at least 3 years in Kafka administration and operations
- Hands on exerience administering Apache Kafka clusters including configuration scaling and upgrades
- Working knowledge of Confluent platform components and operational practices
- Strong troubleshooting skills in distributed systems and experience handling production support and incident management
- Familiarity with Linux fundamentals networking basics and log metric based monitoring for platform health
- Preferred Qualifications
- Experience operating Confluent Platform in enterprise environments including Schema Registry and Kafka Connect administration
- Proven ability to tune Kafka performance broker configs partition strategy replication retention for high throughput workloads
- Experience implementing security best practices ACLs authentication authorization and aligning with governance requirements
- Exposure to automation and scripting to streamline Kafka operations and reduce manual effort
- Strong collaboration skills to guide producer consumer teams on onboarding standards and operational readiness
- Good to have skills
- Kafka Connect Schema Registry Prometheus Grafana