Data Analytics Architect (Databricks)

Essential Duties

• Lakehouse Design: Create a comprehensive Medallion architecture (Bronze, Silver, Gold tiers) utilizing Databricks Delta Lake.
• Governance of Pipelines: Spearhead data governance, security measures, and cataloging initiatives throughout the organization using Unity Catalog.
• Performance Optimization: Enhance Spark clusters, Delta Live Tables (DLT), and Databricks SQL queries to ensure optimal cost-efficiency.
• Leadership in Data Engineering: Develop CI/CD workflows, mentor development teams on PySpark best practices, and convert business needs into technical designs.

Required Skills & Qualifications

• Technical Expertise: Extensive knowledge in Databricks, PySpark, Spark SQL, Delta Lake, and Unity Catalog.
• Cloud Infrastructure: Practical architectural experience with [Azure / AWS / GCP].
• DevOps and Integration: Familiarity with Git, CI/CD tools, orchestration platforms (Airflow/ADF), and business intelligence solutions (Power BI/Tableau).
• Certifications: Possession of Databricks Certified Data Architect or Solutions Architect certification is strongly preferred.