AWS Engineer

Key Responsibilities

• 5 to 8 years of overall IT experience, with a minimum of 6 years in Data Engineering.
• Design and develop solutions using Cloudera, Palantir, and Databricks.
• Develop Python-based automation scripts to optimize workflows and processes.
• Integrate Databricks with AWS ecosystem components such as S3, Glue, Athena, Redshift, and Lambda.
• Define architecture for data-driven solutions.
• Ensure scalability, security, and performance of deployed solutions.
• Collaborate with business teams, data engineers, and developers to align solutions with business goals.
• Optimize Databricks clusters and notebooks for performance and efficiency.
• Apply DevOps practices with familiarity in Jenkins CI/CD pipelines.
• Maintain strong communication skills and adapt quickly to new technologies and requirements.