Senior Data Analyst

Overview:

We are on the lookout for a proficient Data Analyst to become part of our dynamic team. The successful candidate will take charge of data exploration, validation, rule migration, and reporting tasks within the Databricks environment. This position requires working with SAP data to guarantee the quality and precision of data across multiple layers.

Key Responsibilities:

• Identify SAP tables and fields utilized for current Data Quality (DQ) rules and reports, and find the relevant data within Databricks.
• Assess data across all layers (bronze, silver, etc.) in Databricks to ensure completeness, appropriate structure, and availability of necessary fields.
• Choose and develop a set of existing DQ rules in Databricks as part of the Proof of Concept (PoC).
• Implement rules in Databricks and compare outcomes with current DQ results, investigating and addressing any discrepancies.
• Post-PoC, migrate and construct the agreed As-Is DQ rules into Databricks, including SQL logic, data mappings, rule outputs, and required transformations.
• Conduct comprehensive validation of source data, DQ rules, results, and defects in Databricks to ensure the migrated process yields expected results.
• Assist in the development of DQ outputs, KPIs, and dashboard reporting from Databricks, including validation of report results.
• Document data mappings, DQ rules, validation outcomes, and migration procedures.

Qualifications:

• Proven experience in Data Quality / Data Validation.
• Hands-on experience with SAP data, ideally focusing on master data.
• Familiarity with the Databricks platform.
• Experience in reconciling and comparing data across diverse sources.

Essential Skills:

• Proficiency in SQL & Pyspark/Python.
• Capability to convert DQ requirements/rules into technical SQL or Python logic.
• Experience in DQ rule testing, defect analysis, and troubleshooting.

Desirable Skills:

• Solid understanding of SAP tables.

#AditiConsulting
# 26-06390