Azure Data Engineer ( Azure Databricks)

Key Responsibilities

• Design, develop, and optimize large-scale data pipelines using Azure Data Factory, Azure Databricks, and Azure Synapse.
• Implement data lake solutions and work with structured and unstructured datasets in Azure Data Lake Storage (ADLS).
• Collaborate with data scientists, analysts, and engineering teams to design and deliver end-to-end data solutions.
• Develop ETL/ELT processes and integrate data from multiple sources.
• Monitor, debug, and optimize workflows for performance and cost-efficiency.
• Ensure data governance, quality, and security best practices are maintained.

Must-Have Skills

• 4+ years of total experience in data engineering.
• 2+ years of experience with Azure Databricks (PySpark, Notebooks, Delta Lake).
• Strong experience with Azure Data Factory, Azure SQL, and ADLS.
• Proficient in writing SQL queries and Python/Scala scripting.
• Understanding of CI/CD pipelines and version control systems (e.g., Git).
• Solid grasp of data modeling and warehousing concepts.