PEPersistent
Azure Databricks Architecture
Pune ₹15-17 LPA Posted 16 Apr 2025
FULL TIME
Etl
Azure Databricks
Job Description
What You'll Do:
- Managing, developing and supporting data lakes, lake houses, warehouse on premise and on cloud, ETL solutions and other analytics solutions.
- You will work on various types of database technologies.
- You will work Cloud data platform.
- On cloud security models, encryption strategy, network layers for on-prem + cloud hybrid model and other related concepts.
- On cloud data migration for large sized enterprise data warehouse environments.
- Establishing new engineering team and working towards taking the team to steady state.
- On native cloud services (Azure and/or AWS) and Python, Scala, SQL
Expertise You'll Bring:
- 15+ years of hands-on experience with Cloud data platform - most and recent experience in Azure Databricks (AWS will also be acceptable)
- Hands on experience in Databricks and deep understanding of its architecture, capabilities, features, possibilities
- Hands on experience with various types of database technologies
- Experience managing, developing and supporting data lakes, lake houses, warehouse on premise and on cloud, ETL solutions and other analytics solutions.
- Experience with various file formats that support big data
- Experience working with development/engineering teams in a global environment
- In depth practical hands-on experience on native cloud services (Azure and/or AWS) and Python, Scala, SQL
- Strong understanding of cloud DevOps practices and implementation.
- Experience in cloud data migration for large sized enterprise data warehouse environments.
- Understanding of cloud data governance include compute optimization, cost control, user profile management etc.
- In depth understanding of cloud operations strategy and user management across various cloud providers and cloud platforms.
- Strong understanding and hands-on on cloud security models, encryption strategy, network layers for on-prem + cloud hybrid model and other related concepts.
- Experience in establishing new engineering team and working towards taking the team to steady state
- Understanding of SDLC and experience in establishing processes, standards and governance to bring efficiency within development team
