Azure Data factory Data Engineer

Job Description:

• We are seeking a proficient Azure Data Factory (ADF) Data Engineer to create, develop, and sustain scalable cloud-based data integration and analytical solutions.
• The ideal applicant should possess practical experience with Azure Data Factory, Azure Data Lake, SQL, and contemporary data engineering methodologies.
• Your primary responsibility will be to construct robust data pipelines that facilitate data-driven decision-making and support large-scale analytics initiatives across the enterprise.
• You will engage with architects, business analysts, data scientists, and other stakeholders to produce high-quality, scalable, and secure data solutions within the Azure ecosystem.

Key Responsibilities:

• Design, develop, and maintain comprehensive data ingestion and transformation pipelines utilizing Azure Data Factory (ADF).
• Create and optimize ETL/ELT workflows to process substantial volumes of both structured and unstructured data.
• Integrate data from diverse on-premises and cloud-based sources into enterprise-level data platforms.
• Develop and uphold data solutions based on Azure Data Lake Storage (ADLS).
• Monitor, troubleshoot, and enhance ADF pipelines to guarantee reliability and performance.
• Collaborate with business stakeholders to gather requirements and convert them into scalable technical solutions.
• Implement data quality checks, validation mechanisms, and monitoring frameworks.
• Produce reusable components, technical documentation, and best practices for data engineering initiatives.
• Assist with production deployments, resolve issues, and engage in continuous improvement efforts.
• Participate in code reviews and contribute to discussions concerning data architecture and design.

Technical Requirements:

• 2-3 years of experience in Data Engineering and the Azure Data Platform.
• Extensive hands-on experience with Azure Data Factory (ADF).
• Experience with Azure Data Lake Storage (ADLS) Gen2.
• Strong SQL development capabilities, including query optimization and performance tuning.
• Experience in designing and maintaining ETL/ELT pipelines.
• Knowledge of Azure SQL Database, Synapse Analytics, or SQL Server.
• Understanding of data warehousing concepts and dimensional data modeling.
• Experience with version control tools such as Git and Azure DevOps.
• Familiarity with data integration patterns and cloud-based data architectures.
• Exceptional analytical and problem-solving skills.

Additional Responsibilities:

• The Infosys Data Analytics practice aids global enterprises in accelerating their digital transformation through cloud, AI, advanced analytics, and modern data platforms.
• As an Azure Data Engineer, you will be involved in large-scale data modernization projects that encompass cloud migration, data lake implementation, real-time analytics, and AI-ready data platforms.

Preferred Skills:

Technology->Cloud Integration->Azure Data Factory (ADF)