Senior Specialist - Data Engineering

• Design, develop, and optimize large-scale data processing pipelines using Apache Spark
• Build and maintain ETL/ELT workflows using AWS Glue, Amazon S3, and Amazon Athena
• Orchestrate end-to-end data pipelines and processing workflows using AWS Step Functions
• Develop ingestion frameworks to support multi-vendor data schemas, including Ericsson and Oracle datasets
• Standardize transformations, map data, and integrate heterogeneous vendor data into common data models
• Implement data validation, reconciliation, error handling, and data quality controls across ingestion pipelines
• Optimize Spark jobs, Glue workloads, storage structures, queries, and underlying datastore performance
• Monitor pipeline execution, troubleshoot failures, perform root-cause analysis (RCA), and improve processing reliability
• Support schema evolution, metadata management, partitioning, and performance optimization for large datasets
• Collaborate with architecture, platform, analytics, and downstream application teams to ensure scalable and reliable data delivery

Mandatory Skills : AWS Glue