Data Engineer / Cloud Data Architect

Job Overview

We are seeking a skilled Data Engineer / Cloud Data Architect with comprehensive expertise in AWS cloud data platforms, Databricks, IDMC/Informatica, and PySpark. The successful candidate will take charge of designing and implementing robust cloud-based data solutions, data pipelines, migration and modernization projects, as well as analytics architectures.

Key Duties

• Craft and uphold data architecture, roadmaps, blueprints, and reference architectures.
• Create scalable AWS-driven data analytics and engineering solutions.
• Oversee data migration and modernization projects utilizing AWS, Databricks, and IDMC.
• Design and enhance ETL/ELT pipelines, data lakes, data warehouses, and data integration solutions.
• Collaborate with both business and technical stakeholders to convert requirements into scalable data solutions.
• Build and fine-tune data pipelines using PySpark/Spark, Databricks, and AWS-native services.
• Apply automation, CI/CD, and Infrastructure-as-Code methodologies in cloud data environments.
• Ensure compliance with security, governance, compliance, and data management standards.
• Partner with Data Engineering, DevOps, and other technology teams for solution delivery.
• Assist in managing vendor and stakeholder relationships for data and cloud projects.

Essential Skills

• 5–10 years of experience in Data Engineering, Data Warehousing, Big Data, or Cloud Data solutions.
• Proficient hands-on experience with AWS cloud services such as S3, Glue, Redshift, Lambda, Athena, EMR, or Kinesis.
• In-depth experience with PySpark / Spark.
• Practical experience with Databricks and/or Informatica IDMC.
• Strong grasp of data lakes, data warehouses, ETL/ELT, and data modeling.
• Solid knowledge of SQL and Python.
• Experience in data migration, modernization, and cloud-based analytics solutions.
• Good understanding of CI/CD, Terraform/CloudFormation, IAM, and cloud security.
• Excellent stakeholder management and communication abilities.

Desirable Skills

• Tableau / Power BI
• Informatica
• Oracle / SQL Server / MySQL / Teradata
• Delta Lake / MLflow
• AWS Glue / Redshift / EMR
• Event-driven architecture and microservices
• Knowledge of healthcare data governance and compliance
• Experience as a Tech Manager / Cloud Data Architect

Preferred Certifications

• AWS Certified Solutions Architect – Associate/Professional
• Databricks Certified Data Engineer
• Informatica IDMC Certification

Educational Background

A Bachelor's/Master's degree in Computer Science, Information Technology, Computer Engineering, or a related discipline.