Data Engineer

About the Role

We are seeking a talented Data Engineer to assist in the modernization, scaling, and optimization of our cloud data platform. In this position, you will be responsible for constructing resilient data pipelines, transitioning legacy workflows, and overseeing enterprise datasets utilizing AWS, Databricks, and Informatica.

Key Responsibilities

• Pipeline Development: Create and uphold scalable batch and real-time ETL/ELT pipelines utilizing Informatica (IDMC) and Databricks.
• Architecture: Deploy Delta Lake medallion architecture (Bronze/Silver/Gold) and enforce data governance through Unity Catalog on AWS.
• Data Migration: Transform legacy Informatica/on-prem ETL workflows into contemporary PySpark and SQL cloud-based solutions.
• Optimization: Enhance Spark performance, control AWS cloud infrastructure expenses, and streamline CI/CD deployment processes.

Key Requirements

• Technical Stack: Proficiency in Databricks (PySpark, Delta Lake), Informatica (IDMC), and AWS (S3, Glue, Lambda, Redshift).
• Core Languages: Exceptional skills in Python and SQL.
• Experience: 3–6+ years of practical experience in data engineering, data modeling, and cloud pipeline development.