Data Engineer

Role & responsibilities

What You'll Do

Build the underneath data platform and maintain data processing pipelines using best in class technologies.

Special focus on R&D to challenge status-quo and build the next generation data mesh that is efficient and cost effective.

Translate complex technical and functional requirements into detailed designs.

Who You Are

• Strong programming skills (Python, Java, and Scala)
• Experience writing SQL, structuring data, and data storage practices
• Experience with data modeling
• Knowledge of data warehousing concepts
• Experienced building data pipelines and micro services
• Experience with Spark, Airflow and other streaming technologies to process incredible volumes of streaming data
• A willingness to accept failure, learn and try again
• An open mind to try solutions that may seem impossible at first
• Strong understanding of data structures, algorithms, multi-threaded programming, and distributed computing concepts
• Experience working on Amazon Web Services-AWS (EMR, Kinesis, RDS, S3, SQS and the like)

Preferred candidate profile

At least 6+ years of professional experience as a software engineer or data engineer

Education: Bachelor's degree or higher in Computer Science, Data Science, Engineering, or a related technical field.