ADLS + ADF + Azure Functions Professional

Key Responsibilities

• Develop and maintain data solutions using Azure Data Lake Storage (ADLS), Azure Data Factory (ADF), Azure Functions, and Azure SQL.
• Implement CI/CD pipelines for ADF, ADLS, and Azure Functions to enable automated deployments.
• Design and build data ingestion, transformation, and orchestration pipelines using Azure Data Factory.
• Configure and manage ADF components including pipelines, triggers, linked services, datasets, and data flows.
• Integrate data from multiple sources and ensure secure, efficient data movement across systems.
• Develop and optimize SQL queries, stored procedures, and database structures for performance and scalability.
• Perform database design, tuning, and optimization to ensure efficient data processing.
• Work with Azure storage solutions such as Blob Storage, Data Lake Storage, and Azure VMs.
• Configure and manage Git-based version control and CI/CD workflows for Azure services.
• Troubleshoot data pipelines, debugging issues across data flow and integration layers.
• Interpret architecture diagrams, data models, and data flow designs to implement solutions.
• Write automation scripts using Python or PySpark for data processing tasks.