Java Spark

Job Overview

• 6+yrs of Experience in Spark ETL on Big data
• and Above is Must Database knowledge and should be able to write the queries Spark ETL on Big Data
• Knowledge in Spark SQL (Good to have).
• Understand on Regulatory reporting(Good to have).
• Design & implementation of scalable & fault tolerant ETL Pipelines on Big data Platform to store & process terabytes of contract informations from upstream sources with high availability
• Actively work on performance tuning techniques through understanding Spark DAGs on data structures on both Relational & Big Data Platforms giving high performance to both ETL & Reporting Components
• Performs ad-hoc data research & analysis, provide written summaries of results for non-technical business users
• Working with the onsite development team and providing necessary overlap coverage to ensure smooth transition and communication between offshore and onsite
• Work closely with multiple teams(Business Analyst, ETL, DB team, Infra, Support, etc )
• Work collaboratively in a small, cross-functional Global Team