Senior Specialist - Data Engineering

Role Description

We are seeking an Azure Databricks Platform Administrator with 6–13 years of experience, bringing strong expertise in Databricks platform administration and Azure cloud services.

Platform Administration

• Administer and provide support for Databricks workspaces across development, testing, and production environments
• Configure and maintain Databricks account-level and workspace-level settings
• Manage clusters, SQL Warehouses, jobs, pools, policies, and platform configurations
• Support platform upgrades, runtime updates, and feature enablement activities.
  
  

Security Access Management

• Handle user provisioning and deprovisioning through Azure AD Identity Management systems
• Administer Workspace Admin Account Admin and Unity Catalog permissions
• Implement RBAC and least-privilege access controls
• Conduct periodic access reviews and support audit compliance activities
• Ensure compliance with organizational security standards and governance policies
  
  

Unity Catalog Data Governance

• Manage catalogs, schemas, tables, grants, and data access permissions
• Support data governance and metadata management initiatives
• Monitor adherence to enterprise data security requirements
  
  

Operations Monitoring

• Monitor platform health, performance, utilization, and availability
• Carry out proactive capacity management and optimization
• Troubleshoot cluster, job, notebook, and connectivity issues
• Create and maintain operational dashboards and monitoring.
  
  

Incident Problem Management

• Participate in incident response and root cause analysis
• Coordinate with cloud network security and Databricks vendor teams to resolve issues
• Lead problem management and continuous service improvement initiatives
  
  

Release Change Management

• Support platform changes, upgrades, and release deployments
• Execute change management procedures and documentation
• Evaluate operational risks tied to platform changes
  
  

Platform Enablement

• Support onboarding of new applications and projects onto Databricks
• Help development teams with platform best practices and standards
• Create and maintain operational runbooks, SOPs, and technical documentation
  
  

Strong Experience With Below

• Azure Databricks or AWS Databricks
• Unity Catalog
• Azure Active Directory Identity Management
• SQL and data platform concepts
• Access management and RBAC
• Incident and change management processes, monitoring tools
• Experience supporting production platforms in regulated enterprise environments
  
  

Nice To Have Certifications

• Databricks Certified Data Engineer Associate Professional
• Databricks Certified Platform Administrator