Big Data developer

Key Responsibilities

• Design and implement data pipelines using Azure Databricks, Azure DLS, and related services
• Build scalable big data processing solutions using Apache Spark with Scala/Java
• Work with large data sets and optimize ETL processes
• Collaborate with cross-functional teams in an Agile delivery environment
• Ensure best practices in cloud-based data engineering and performance tuning
• Participate in code reviews, testing, and deployments