CO
Job Description
- The ideal candidate will be responsible for designing, developing, and maintaining big data solutions on AWS.
- This role requires a deep understanding of big data technologies, cloud architecture, and best practices in data engineering.
Responsibilities:
- Design, develop, and maintain big data solutions using AWS services. Implement data processing architectures, including data ingestion, storage, processing, and analysis.
- Collaborate with cross-functional teams to define data requirements and deliver solutions.
- Ensure scalability, security, and cost-effectiveness of data solutions.
- Develop and maintain ETL pipelines to process large volumes of data.
- Monitor and optimize data workflows for performance and reliability.
- Troubleshoot and resolve data-related issues in a timely manner.
- Create and maintain documentation for data solutions and processes.
Qualifications:
- Bachelor's degree in Computer Science, Information Technology, or a related field.
- 3+ years of experience in big data engineering. Proven experience with AWS services such as EMR, S3, Redshift, Lambda, and Glue.
- Strong understanding of big data technologies like Hadoop, Spark, and Kafka.
- Experience with data modeling, ETL processes, and data warehousing.
- Proficiency in programming languages such as Python, Java, or Scala. Excellent problem-solving skills and attention to detail.
- Ability to work independently as well as part of a team.
Skills:
- Proficiency in AWS big data services (EMR, S3, Redshift, Lambda, Glue).
- Strong knowledge of big data technologies (Hadoop, Spark, Kafka).
- Experience with ETL tools and processes.
- Familiarity with data modeling and data warehousing concepts.
- Excellent communication and collaboration skills.
- Ability to manage multiple tasks and projects simultaneously.
