Data Specialist - R01562275

Key Responsibilities

Data Pipeline Development (AWS Cloud)

• Design and implement scalable data pipelines using AWS services such as Kinesis, Athena, and Redshift
• Develop efficient ETL processes for data ingestion, transformation, and loading
• Ensure smooth and reliable data flow across batch and real-time systems

Real-Time Data Processing & Messaging

• Configure and manage AWS messaging services including SNS and SQS
• Build event-driven architectures for real-time data streaming and processing
• Ensure low-latency and fault-tolerant data delivery pipelines

Data Warehousing & Analytics

• Develop and optimize data models in Amazon Redshift for analytical workloads
• Use AWS Athena for serverless querying and data exploration
• Support business intelligence and analytics teams with curated datasets

Monitoring, Reliability & Troubleshooting

• Monitor pipelines using AWS CloudWatch for performance, logs, and alerts
• Identify and resolve data pipeline failures and performance bottlenecks
• Ensure high availability and system reliability for data workflows

Security, Governance & Compliance

• Implement secure data handling practices using AWS IAM for access control
• Ensure compliance with organizational data security standards
• Maintain secure and governed data pipelines across AWS environments

Automation & Optimization

• Automate data workflows to reduce manual intervention and improve efficiency
• Optimize ETL jobs for performance and cost efficiency
• Improve scalability of data systems through best engineering practices

Collaboration & Documentation

• Work closely with data analysts, engineers, and stakeholders to define data requirements
• Translate business needs into technical data solutions
• Maintain clear documentation for data pipelines, architecture, and operational processes