PE

Databricks Dev

Persistent
Mumbai10-17 LPA Posted 16 Apr 2025
FULL TIME
Cloud Technologies
Data Lake
Databricks

Job Description

What You'll Do:

  • Been Leading and built at least 2-3 Projects on Azure cloud with Databricks
  • Strong experience in designing and building DWH, Data lake ETL based applications with scalability and performance
  • Experience with CDC and metadata driven based processing
  • Have build DWH models
  • Strong analytical/problem solving mindset but with the ability and willingness to get into the details to find solutions.
  • Must have experience in talking to business team and understand the requirement and provide optimal technical solution
  • Take ownership and responsibility for end-to end solutioning and implementation within the timeline.
  • Debug and Resolve/provide solution to Data issues/mismatch
  • Code optimization
  • Advanced SQL

Expertise You'll Bring:

  • Cloud technologies (Azure data services, Azure ADLS, SHIR, ADF, Integration with Active directory, masking and encryption, Governance activities Lineage, Catalog, classifications. Infrastructure setup in Azure)
  • Experienced with multiple data-ingestion methods for loading data to Databricks: ADF, python, pyspark, Copy Into for large volume of data as well as incremental data handling
  • Sound knowledge of Databricks Architecture, Design and Performance considerations
  • Data lake and Data Warehouse Design and optimization
  • ETL, Data Analysis, CDC

Join WhatsApp Channel