Data Engineer

Essential Skills:

▪ Oversee a team of data engineers responsible for the daily operations of business-as-usual (BAU), production support, incident resolution, and ensuring platform stability.

▪ Extensive expertise in AWS, including the design of new architectures and optimization of existing solutions. (S3, Glue, DMS, MWAA, AMS, IAM).

▪ Profound understanding of Snowflake and its architectural framework.

▪ Previous experience in a BAU setting is preferred.

▪ Solid knowledge of Airflow and MWAA.

▪ Practical experience in SQL, Python, and Pyspark.

▪ Proficient in optimization strategies within cloud environments.

▪ Possess a strategic vision for data management and the ability to execute that vision.

▪ Capable of leading the design and execution of data management processes, encompassing data sourcing, integration, and transformation.

▪ Skilled in managing and guiding a team of data professionals, offering mentorship, and cultivating a collaborative and innovative team atmosphere that prioritizes continuous improvement.

▪ Responsible for assessing and recommending data-related technologies, tools, and platforms.

▪ Work closely with IT teams to ensure the smooth integration of data solutions.

▪ Experience in establishing and enforcing data security protocols while ensuring compliance with applicable regulations.

Required Qualifications:

▪ A minimum of 8 years of experience in Data Engineering.

▪ Bachelor's degree in Computer Science or a related field in STEM (science, technology, engineering, or mathematics).

▪ At least 5 years of recent hands-on professional experience actively coding while serving as a Lead in support and production issue resolution.

▪ 2+ years of experience with large-scale datasets, as well as data lake and data warehouse technologies such as AWS Redshift, Google BigQuery, and Snowflake, with Snowflake being highly preferred.