Data Engineer (Data Ingestion & Platforms)

Overview

We are seeking a Data Engineer to become part of a high-achieving enterprise data team dedicated to delivering and supporting essential data ingestion functionalities within a large-scale data platform. This position is perfect for engineers who thrive on constructing production-level data solutions, addressing operational challenges, and engaging with contemporary data technologies in an enterprise setting.

In the role of Data Engineer, you will be tasked with the design, development, and support of data ingestion pipelines and backend data services that drive enterprise data platforms. This position merges hands-on Python engineering, data platform development, and production support duties.

Key Responsibilities

• Create, develop, maintain, and improve data ingestion pipelines to meet ongoing operational needs.
• Ingest and process data from both external providers and internal sources into enterprise data platforms.
• Design and develop scalable Python backend services to support data systems and workflows.
• Provide support for BAU operations, including monitoring, troubleshooting, maintenance, and resolution of issues for production workloads.
• Enhance existing data engineering solutions and contribute to platform advancements.
• Collaborate with Infrastructure, Database, Network, and Data Steward teams to ensure the reliable delivery of data services.
• Assist with testing, deployment activities, and operational stability during monthly and quarterly releases.
• Occasionally participate in after-hours support for critical production incidents when necessary.

Essential Qualifications

• Extensive hands-on experience with Python for data engineering and pipeline development.
• Solid foundation in Python backend engineering.
• Expertise in Snowflake, encompassing data ingestion, querying, schema management, and data warehouse operations.
• Strong SQL proficiency and experience handling large-scale datasets.
• Basic to intermediate knowledge of Databricks.
• Experience in supporting production data platforms and troubleshooting operational challenges.
• Capable of working independently and contributing with minimal oversight.
• Excellent communication and stakeholder management abilities.

Preferred Qualifications

• Experience with REST APIs and external data integrations.
• Familiarity with Java or Java-based integration services.
• Background in financial services or other regulated sectors.
• Exposure to modern data architectures and cloud-based data platforms.

Why You Should Apply

• Engage with large-scale, business-critical data platforms utilized throughout the organization.
• Gain exposure to cutting-edge technologies such as Snowflake and Databricks.
• Participate in initiatives for data platform modernization aligned with future AI capabilities.
• Develop expertise in complex external data ingestion and enterprise-level data operations.
• Make a significant impact in a highly visible, production-critical environment.

Please note that only candidates selected for further consideration will be contacted.

EA registration number: WONG LIN, RACHEL, R25158204

Allegis Group Singapore Pte Ltd, Company Reg No. 200909448N, EA Licence No. 10C4544