ADAditi Tech Consulting Private Limited
Data Analyst
Bangalore Posted 19 Nov 2026
FULL TIME
defect analysis
Data Quality
Pyspark
Sql
data reconciliation
+5 more
Job Description
Summary:
This role focuses on the identification, validation, and migration of Data Quality (DQ) rules from SAP to Databricks. You will leverage expertise in SAP data structures and the Databricks platform to maintain data quality and integrity throughout the migration lifecycle.
Job Responsibilities:
- Data Discovery: Identify the SAP tables and fields associated with existing DQ rules and reports, then determine where the corresponding data exists within Databricks.
- Data Validation: Validate data in Databricks across all layers (including bronze, silver, etc.) to confirm completeness, structure, and availability of required fields.
- DQ Rule Migration & BUILD: Select and implement a set of existing DQ rules in Databricks as part of the PoC.
- PoC Testing & Reconciliation: Run the rules in Databricks and compare outcomes against the existing DQ results; investigate and resolve any discrepancies.
- End-to-End Rule Migration: After the PoC, migrate/BUILD the agreed As-Is DQ rules into Databricks, including SQL logic, data mappings, rule outputs, and all necessary transformations.
- Data & Rule Validation: Conduct end-to-end validation of source data, DQ rules, results, and defects within Databricks to ensure the migrated solution delivers the expected outcomes.
- DQ Reporting: Assist with the creation of DQ outputs, KPIs, and dashboard reporting from Databricks, including validation of reported results.
- Documentation & BAU Handover: Document data mappings, DQ rules, validation outcomes, and the migration approach.
Required Skills:
- Strong proficiency in SQL & Pyspark/Python.
- Experience in Data Quality/Data Validation.
- Experience working with SAP data, preferably master data.
- Solid understanding of SAP tables.
- Experience with the Databricks platform.
- Experience in data reconciliation and comparison between different data sources.
- Ability to convert DQ requirements/rules into technical SQL or Python logic.
- Experience with DQ rule testing, defect analysis, and troubleshooting.
Education & Qualifications:
No specific educational qualifications are provided; however, relevant experience and demonstrated skills in data quality, SAP, and Databricks are required.
#AditiConsulting
#26-07319
