IT&Data Engineer

Job Overview:

• Purpose of the Role
• The individual in this position will develop governed, reusable data products that enhance OneHouse, the central lakehouse, while facilitating transformations within Data Transformation Units (DTUs). This role will also elevate the technical standards of the squad through mentoring, design counseling, and maintaining code quality.
• As a member of the chapter, this position provides technical leadership at the squad level, without any responsibilities for people management or setting standards, which are reserved for the Chapter Manager and Chapter Lead.
• Level Reporting Note: This is an individual contributor position at Level 9.
• The role reports to the Data & Analytics Engineering Chapter Manager at Level 8, maintaining the chapter's reporting hierarchy with the Chapter Lead and Chapter Team Members.
• Responsibilities related to people management, staffing, and standard setting are explicitly excluded to differentiate this role from that of the Level 8 Chapter Manager.
• Main Objectives
• Ensure the technical quality and reliability of data products delivered through OneSource 2 within the squad.
• Act as a hands-on technical resource and mentor, ensuring that Bronze, Silver, and Gold datasets function as a trusted Single Source of Truth (SSOT) under the guidance of the Chapter Manager.

Core Responsibilities:

• Provide technical leadership at the squad level.
• Serve as the technical reference for the squad's data engineering initiatives on OneSource 2.
• Guide solution development within established guardrails, driving design and code quality through peer review.
• Mentor and enhance the skills of junior data engineers, assisting with estimation and technical planning.
• Contribute to Engineering Decision Records (EDRs) for implementation-level decisions.
• Data Ingestion Configuration
• Utilize the OneHouse metadata-driven framework to configure ingestion, create and modify JSON configuration files for Bronze ingestion, and deploy via GitHub and GitOps CI/CD.
• Onboard data sources such as SAP, DB2, and Snowflake, ensuring reliability, completeness, and data lineage into OneHouse.
• Transformation and Data Modeling
• Develop Silver cleaned, harmonized models and Gold business aggregation datasets, implementing key business KPIs.
• Utilize and update reusable logic from the Transformations Library, documenting and versioning it appropriately.
• Translate KPI definitions into scalable transformations aligned with domain-specific data models.
• Platform Engineering within DTUs
• Engage in development within DTUs using Databricks, Spark SQL, Delta Lake, and, where applicable, ADF, Snowflake, or Informatica.
• Structure data across Bronze, Silver, and Gold layers, optimizing for performance, cost efficiency, and scalability.
• Implement best practices for CI/CD, Infrastructure as Code (IaC), monitoring, and data quality checks.
• Governance of Data Products
• Ensure the integrity of ingested data and entities in Unity Catalog, adhering to GBDO Data Owner validation and security principles.
• Guarantee that only data stored and cataloged in OneHouse is published as shareable, certified data products (SSOT).

Technical Qualifications:

• Required Expertise
• Extensive experience as a Data Engineer in enterprise settings with hands-on experience in OneSource 2.
• Proficiency in OneHouse DTU practices.
• Mandatory experience with Databricks, Spark SQL, and Delta Lake; exposure to ADF, Azure, Snowflake, or Informatica is a plus.
• Strong skills in data modeling for analytics, including facts, dimensions, derived metrics, and medallion architecture.
• Familiarity with configuration as code using GitHub and CI/CD methodologies, with experience integrating ERP, Finance, and Commercial data (e.g., SAP).
• Leadership Positioning - Technical, Not Managerial
• Recognized as a technical authority within the squad, capable of coaching junior members and articulating design decisions amid competing alternatives.
• Operates under the guidance of the Chapter Manager, without responsibilities for people management or standard-setting.

Additional Duties:

• Responsible for creating governed Bronze, Silver, and Gold data products in OneHouse and DTUs while mentoring junior engineers, reporting to the Level 8 Chapter Manager.
• This lead role reflects technical seniority and maintains a clear distinction from a management layer, positioning it one level below the Chapter Manager within the chapter hierarchy.

Preferred Skills:

Technology->Data Engineering->Databricks