Data & Integration Engineer

Position: Data & Integration Engineer

Primary Responsibilities:

1. System Analysis & Design

• Evaluate business and technical requirements, converting them into data flows and integration designs
• Collaborate with upstream and downstream teams to establish data contracts and interfaces
• Detect gaps, inefficiencies, and risks in existing data movement processes
• Suggest practical solutions that balance speed, quality, and maintainability

2. Integration & Data Movement

• Create and execute data movement solutions across systems utilizing:
• APIs
• SFTP and file-based transfers
• Batch pipelines
• Oversee integrations within the DataLake ecosystem (Informatica, Cloudera, etc.)
• Ensure accurate transformation, mapping, and delivery of data to target systems
• Resolve integration issues across various environments

3. Data Preparation for GenAI

• Assist in data ingestion and preparation for GenAI applications:
• document ingestion
• data aggregation
• enrichment and transformation
• Handle both structured and unstructured data
• Guarantee data usability for downstream AI processes (RAG, search, investigation flows)

Note: You are not tasked with building models, but rather making data accessible for them.

4. Delivery & Coordination

• Collaborate with various teams:
• data platforms
• application teams
• infrastructure
• security
• Assist in SIT, UAT, and production deployments
• Ensure integration reliability, effective error handling, and monitoring
• Clearly document flows, mappings, and interfaces