Data Engineer

Job Responsibilities:

• Develop and maintain data pipelines for large-scale data processing.
• Work with streaming data technologies, including Kafka, kSQL, and Mirror Maker.
• Design and implement near real-time data streaming solutions.
• Optimize ETL processes for performance, scalability, and reliability.
• Collaborate with cross-functional teams to ensure seamless data integration.
• Ensure data quality, security, and compliance with best practices.

Mandatory Skills & Qualifications:

• At least 7 years of experience in data-focused development projects.
• Expertise in Kafka framework, including kSQL and Mirror Maker.
• Proficiency in at least one programming language: Groovy or Java.
• Strong knowledge of data structures, ETL design, and storage optimization.
• Hands-on experience in real-time/streaming data pipeline development using Apache Spark, StreamSets, Apache NiFi, or similar frameworks.