Apache Airflow Dev

Description

We are seeking an experienced Apache Airflow Developer to join our team in India. The ideal candidate will have a strong background in workflow orchestration and data engineering, with a passion for building scalable data pipelines.

Responsibilities

• Design, develop, and maintain workflows using Apache Airflow.
• Implement and optimize data pipelines for data ingestion and transformation.
• Monitor and troubleshoot existing workflows to ensure performance and reliability.
• Collaborate with data engineers and data scientists to understand workflow requirements.
• Document workflow processes and provide training to team members.

Skills and Qualifications

• 4-6 years of experience in Apache Airflow or similar workflow orchestration tools.
• Strong understanding of Python programming and its libraries.
• Experience with SQL and relational databases like PostgreSQL or MySQL.
• Familiarity with cloud platforms such as AWS, GCP, or Azure.
• Knowledge of data processing frameworks like Apache Spark or Apache Kafka.
• Experience with version control systems like Git.
• Strong problem-solving skills and attention to detail.