Data Engineer (Vulnerability Scanner)

We are collaborating with a government agency in Singapore that is seeking a Data Engineer to become a part of their Platform team. This position is centered around converting cyber asset data into trustworthy datasets, informative dashboards, and actionable insights to enhance asset visibility, manage vulnerabilities, and facilitate incident response.

Key Responsibilities

• Architect and sustain data models that integrate information from various sources, including CMDBs, vulnerability scanners, and agency systems.
• Create and oversee data pipelines to cleanse, transform, enrich, and verify data.
• Design and maintain dashboards and visualizations for asset visibility, prioritization of vulnerabilities, and tracking remediation efforts.
• Assess data quality, monitor pipeline performance and data freshness, and address any data-related issues.
• Enhance queries and data refresh mechanisms to guarantee dependable and swift dashboards.
• Collaborate with Business Analysts and Infrastructure Engineers to fulfill agency needs and provide actionable insights.
• Document data models, transformation methodologies, and dashboard requirements.

Qualifications

• Minimum of 3 years' experience in data engineering, analytics engineering, or business intelligence.
• Proficient in SQL and experienced with data transformation tools such as dbt, Apache Spark, or similar technologies.
• Practical experience with business intelligence and visualization tools, including Power BI, Tableau, Grafana, or Superset.
• Familiarity with data modeling and handling data from diverse sources.
• Solid understanding of data quality, validation, and pipeline management practices.
• Experience with Python and orchestration tools like Airflow, Dagster, or Prefect is a plus.
• Exposure to cyber asset data, CMDBs, or vulnerability scanning tools is advantageous.