PE

Azure Databricks Architecture

Persistent
Pune15-17 LPA Posted 16 Apr 2025
FULL TIME
Etl
Azure Databricks

Job Description

What You'll Do:

  • Managing, developing and supporting data lakes, lake houses, warehouse on premise and on cloud, ETL solutions and other analytics solutions.
  • You will work on various types of database technologies.
  • You will work Cloud data platform.
  • On cloud security models, encryption strategy, network layers for on-prem + cloud hybrid model and other related concepts.
  • On cloud data migration for large sized enterprise data warehouse environments.
  • Establishing new engineering team and working towards taking the team to steady state.
  • On native cloud services (Azure and/or AWS) and Python, Scala, SQL

Expertise You'll Bring:

  • 15+ years of hands-on experience with Cloud data platform - most and recent experience in Azure Databricks (AWS will also be acceptable)
  • Hands on experience in Databricks and deep understanding of its architecture, capabilities, features, possibilities
  • Hands on experience with various types of database technologies
  • Experience managing, developing and supporting data lakes, lake houses, warehouse on premise and on cloud, ETL solutions and other analytics solutions.
  • Experience with various file formats that support big data
  • Experience working with development/engineering teams in a global environment
  • In depth practical hands-on experience on native cloud services (Azure and/or AWS) and Python, Scala, SQL
  • Strong understanding of cloud DevOps practices and implementation.
  • Experience in cloud data migration for large sized enterprise data warehouse environments.
  • Understanding of cloud data governance include compute optimization, cost control, user profile management etc.
  • In depth understanding of cloud operations strategy and user management across various cloud providers and cloud platforms.
  • Strong understanding and hands-on on cloud security models, encryption strategy, network layers for on-prem + cloud hybrid model and other related concepts.
  • Experience in establishing new engineering team and working towards taking the team to steady state
  • Understanding of SDLC and experience in establishing processes, standards and governance to bring efficiency within development team

Required Skills

Join WhatsApp Channel