Job Details

Responsibilities:

Monitor existing operational pipeline dashboards, and dashboard refactoring
Monitor and optimize data workflows for performance and scalability.
Implement monitoring capabilities and alerts for production data pipelines using Azure Log Analytics and KUSTO Query Language
Troubleshoot and resolve issues related to data processing.
Contribute to data engineering / Databricks internal wiki
Collaborate with data scientists, analysts, and other engineers to ensure data reliability and availability.

Education:

Bachelor s degree in computer science, Information Technology or any other related discipline

Preferred Certifications:

Work Experience:

7-10 years of directly related or relevant experience, preferably in application support or system/application/database administration.
In-depth knowledge of Microsoft Azure components Microsoft Pipelines
Hands on experience on data lake activities such as Azure Data Factory, Event Hubs, Databricks, Synapse, Blob Storage, Log Analytics, Stream Analytics, etc
Expertise on Azure Devops with hands on in developing and maintaining Microsoft Pipelines (commonly referred too as CI/CD)
Expertise in developing and maintaining data pipelines using Debezium (not mandatory), Databricks and Azure services.
Strong knowledge of data modeling, STAR Schema, ETL, and real-time data streaming.
Experience creating dashboards and reports in Power BI or similar tool
Familiarity with SQL, Python, and KUSTO Query Language
Familiar with agile / scrum / kanban
Exposure to Scripting/programming Languages (e.g. SQL, KQL, Python)

Skills and Knowledge:

Azure Data Engineer