Microsoft Azure Analytics Services Expert

Roles & Responsibilities:

• Design and develop end-to-end data pipelines using Azure Data Factory
• Build scalable data processing solutions using Azure Databricks with PySpark and Spark SQL
• Develop and optimize ETL/ELT workflows for both structured and unstructured data
• Integrate data from multiple sources including APIs, databases, and cloud platforms
• Implement and manage Azure Data Lake Storage (ADLS Gen2) and data warehouse solutions
• Monitor, troubleshoot, and optimize pipeline performance and processing efficiency
• Implement data quality checks, validation rules, and governance standards
• Collaborate with data analysts, business stakeholders, and DevOps teams for successful delivery
• Manage CI/CD pipelines and deployments using Azure DevOps
• Ensure data security, compliance, and cost-performance optimization in Azure environments