Data Engineer

What You'll Do:

• Understand the domain for which the entities are being created.
• Understand the entity creation process framework- both batch and real time.
• Create entity structure in the datamap studio.
• Use the existing entity creation framework to create and populate entities using either the batch method OR the real time events method.
• Publish the entities in datamap studio and configure quality checks and execution schedule of the jobs.

Expertise You'll Bring:

• SQL, Java or Python, AWS (EMR, S3, Lambda)
• Strong in SQL.
• Programming- Java OR Python.
• AWS - (S3, EMR, Lambda)
• Good to have knowledge- spark, scala, hive.
• Good to have: Knowledge of Spark, Scala, and Hive.