Azure Backend Expert (ADLS, ADF and Azure SQL DW)

• Should have hands-on experience of working with ADLS, ADF and Azure SQL DW
• Should have minimum 3 Years working experience of delivering Azure projects.

Must Have:

• 3 to 8 years of experience working on design, develop, and deploy ETL processes on Databricks to support data integration and transformation.
• Optimize and tune Databricks jobs for performance and scalability.
• Experience with Scala and/or Python programming languages.
• Proficiency in SQL for querying and managing data.
• Expertise in ETL (Extract, Transform, Load) processes.
• Knowledge of data modeling and data warehousing concepts.
• Implement best practices for data pipelines, including monitoring, logging, and error handling.
• Excellent problem-solving skills and attention to detail.
• Excellent written and verbal communication skills
• Strong analytical and problem-solving abilities.
• Experience in version control systems (e.g., Git) to manage and track changes to the codebase.
• Document technical designs, processes, and procedures related to Databricks development.
• Stay current with Databricks platform updates and recommend improvements to existing process.

Good to Have:

Agile delivery experience

• Experience with cloud services, particularly Azure (Azure Databricks), AWS (AWS Glue, EMR), or Google Cloud Platform (GCP).
• Knowledge of Agile and Scrum Software Development Methodologies.
• Understanding of data lake architectures.
• Familiarity with tools like Apache NiFi, Talend, or Informatica.
• Skills in designing and implementing data models.