Azure Databricks

Description

We are seeking an experienced Azure Databricks professional to join our team in India. The ideal candidate will have a strong background in data engineering, specifically with Azure Databricks ,Azure Factory ,Pyspark ,SQL.

Responsibilities

• Designing and implementing data pipelines using Azure Databricks.
• Collaborating with data engineers and data scientists to support data analytics initiatives.
• Optimizing Spark applications for performance and scalability.
• Developing ETL processes to transform and load data into Azure Databricks.
• Monitoring and troubleshooting data processing jobs in Azure Databricks.
• Integrating Databricks with Azure Data Lake Storage and other Azure services.
• Ensuring data quality and implementing best practices for data governance.

Skills and Qualifications

• 5-11 years of experience in data engineering or related fields.
• Strong proficiency in pyspark and Azure Databricks.
• Experience with ETL tools and data processing techniques.
• Proficient in programming languages such as Python, Scala, or SQL.
• Understanding of machine learning concepts and libraries is a plus.