ADF Databricks/Snowflake Consultant

Job Overview:

• We are seeking an experienced Data Engineer with practical expertise in Azure Data Factory (ADF), Azure Databricks, or Snowflake.
• The successful candidate will focus on the design, development, and maintenance of scalable data pipelines and integration solutions to fulfill enterprise-level analytics and reporting needs.
• Relevant experience with ADF, Databricks, or Snowflake is frequently noted in similar internal requirements for Data Engineers.

Primary Responsibilities:

• Create and enhance data ingestion and transformation workflows in Snowflake.
• Develop robust solutions utilizing PySpark and SQL.
• Execute data quality checks, monitoring, and performance optimization.
• Handle both structured and unstructured data from diverse sources.
• Collaborate with business stakeholders, architects, and cross-functional teams to provide effective data solutions.
• Diagnose production issues and offer continuous support for data platforms.
• Ensure compliance with data governance, security measures, and industry best practices.

Technical Qualifications:

• Proficient in Azure Data Factory (ADF).
• Hands-on experience with Azure Databricks and PySpark.
• Extensive development experience with Snowflake.
• Advanced proficiency in SQL.
• Familiarity with Azure Data Lake Storage (ADLS) and the Azure ecosystem.
• Solid understanding of data warehousing principles and dimensional modeling.

Additional Skills:

• Strong analytical and problem-solving capabilities.
• Experience in Agile work environments.
• Exceptional communication and stakeholder management abilities.
• Capacity to work autonomously and deliver high-quality solutions.

Preferred Expertise:

Cloud Integration: Azure Data Factory (ADF), Data Engineering: Databricks, Cloud Data Storage: Snowflake