AWS Lead Data Engineer

Job Overview:

• We are on the lookout for a seasoned AWS Lead Data Engineer who possesses significant IT experience in the design and implementation of large-scale cloud-based data infrastructures.
• The successful candidate will demonstrate profound expertise in AWS data services, data lake architectures, ETL frameworks, and enterprise-level data governance solutions.

Primary Responsibilities:

• Construct and sustain scalable data pipelines utilizing AWS Glue, Lambda, and Step Functions.
• Develop and enhance data ingestion frameworks based on Amazon S3 data lakes.
• Architect and execute intricate ETL and ELT workflows for both structured and unstructured data.
• Create reusable components and automation frameworks for efficient data processing.
• Enforce data governance and access control mechanisms through Lake Formation and IAM.
• Deploy and oversee containerized applications on ECS.
• Refine data processing performance, reliability, and scalability.
• Conduct troubleshooting, root cause analysis, and provide production support.
• Work collaboratively with cross-functional teams to deliver data solutions aligned with business objectives.
• Guide and mentor junior engineers, offering technical support to project teams.

Technical Qualifications:

• Proven IT experience with a robust background in Data Engineering.
• Hands-on proficiency with AWS Glue, Lambda, Step Functions, S3, and Lake Formation.
• Strong programming skills in Python and SQL.
• Experience in developing enterprise-scale Data Lake solutions.
• Solid understanding of IAM roles, policies, and AWS security best practices.
• Familiarity with container technologies and ECS.
• Extensive knowledge of ETL, Data Warehousing, and Data Modeling principles.
• Experience working within Agile delivery frameworks.

Desired Skills:

Technology->DevOps->AWS - Infrastructure Core Services->AWS Cloud WAN