ADF Data developer

Skills and Experience:

• Degree in Data Analytics/Computer Science or equivalent work experience
• 3 years plus experience as an Azure Data Engineer or in a similar data engineering role using Microsoft Azure Cloud (Data Factory, Azure Functions, Databricks, etc.).
• Practical Experience to Azure Fabric (Ideally DP-700 certified)
• Proven experience in building and optimising big data pipelines and architectures
• Strong analytical skills, especially in working with unstructured data
• Proficient in designing and implementing well-written code
• Experience with data pipeline testing, from source to presentation layer including troubleshooting skills

Key Responsibilities:

• Design, implement, and maintain data pipelines for data ingestion, processing, and transformation in Azure.
• Work together with data scientists and analysts to understand the needs for data and create effective data workflows.
• Create and maintain data storage solutions including Azure SQL Database, Azure Data Lake, and Azure Blob Storage.
• Utilizing Azure Data Factory or comparable technologies, create and maintain ETL (Extract, Transform, Load) operations.
• Implementing data validation and cleansing procedures will ensure the quality, integrity, and dependability of the data.
• Improve the scalability, efficiency, and cost-effectiveness of data pipelines.
• Monitoring and resolving data pipeline problems will guarantee consistency and availability of the data.