Azure Data factory Data Engineer

Job Description:

• We are seeking an experienced Azure Data Factory (ADF) Data Engineer to architect, develop, and sustain scalable cloud-based data integration and analytics solutions.
• The successful candidate will possess hands-on experience with Azure Data Factory, Azure Data Lake, SQL, and contemporary data engineering methodologies.
• Your primary responsibility will be to construct robust data pipelines that facilitate data-driven decision-making and bolster enterprise-scale analytics projects.
• You will collaborate with architects, business analysts, data scientists, and stakeholders to deliver high-quality, scalable, and secure data solutions within the Azure environment.

Key Responsibilities:

• Design, develop, and maintain comprehensive data ingestion and transformation pipelines utilizing Azure Data Factory (ADF).
• Construct and enhance ETL/ELT workflows for processing substantial volumes of both structured and unstructured data.
• Integrate data from various on-premises and cloud sources into enterprise data platforms.
• Develop and maintain data solutions based on Azure Data Lake Storage (ADLS).
• Monitor, troubleshoot, and optimize ADF pipelines to guarantee reliability and performance.
• Work closely with business stakeholders to gather requirements and convert them into scalable technical solutions.
• Implement data quality assessments, validation mechanisms, and monitoring frameworks.
• Produce reusable components, technical documentation, and best practices for data engineering initiatives.
• Assist with production deployments, issue resolution, and continuous enhancement efforts.
• Engage in code reviews and contribute to discussions regarding data architecture and design.

Technical Requirements:

• 3-5 years of experience in Data Engineering and on the Azure Data Platform.
• Proficient hands-on experience with Azure Data Factory (ADF).
• Experience with Azure Data Lake Storage (ADLS) Gen2.
• Strong SQL development capabilities, including query optimization and performance tuning.
• Experience in designing and maintaining ETL/ELT pipelines.
• Familiarity with Azure SQL Database, Synapse Analytics, or SQL Server.
• Understanding of data warehousing principles and dimensional data modeling.
• Experience with source control tools such as Git and Azure DevOps.
• Knowledge of data integration patterns and cloud-based data architectures.
• Excellent analytical and problem-solving abilities.

Additional Responsibilities:

• The Infosys Data Analytics practice aids global enterprises in accelerating their digital transformation through cloud technologies, AI, advanced analytics, and modern data platforms.
• As an Azure Data Engineer, you will engage in enterprise-scale data modernization projects, encompassing cloud migration, data lake implementation, real-time analytics, and AI-ready data platforms.

Preferred Skills:

Technology->Cloud Integration->Azure Data Factory (ADF)