Senior Data Engineer (Flexcube)

We are seeking a skilled Data Engineer with extensive experience in the Hadoop ecosystem and a strong background in integrating and managing data from FLEXCUBE core banking systems. The ideal candidate will play a key role in designing, implementing, and optimizing our data pipelines, ensuring seamless data flow and analysis.

Key Responsibilities:

• Data Integration: Lead the integration of data from FLEXCUBE core banking systems into our Hadoop-based data infrastructure. Develop and maintain efficient data ingestion processes.
• Hadoop Ecosystem: Design, build, and optimize data pipelines within the Hadoop ecosystem, including HDFS, Sqoop, Unix shell scripting, Python coding and Spark.
• Data Modelling: Create and maintain data models, schemas, and structures to support data analysis and reporting requirements.
• ETL Processes: Develop Extract, Transform, Load (ETL) processes to cleanse, enrich, and transform data for downstream consumption.
• Data Quality: Implement data quality checks and monitoring processes to ensure the accuracy, completeness, and consistency of data.
• Performance Optimization: Optimize data processing and query performance within the Hadoop ecosystem.
• Data Security: Ensure data security and compliance with data privacy regulations during data handling and processing.
• Documentation: Maintain thorough documentation of data pipelines, transformations, and data flow processes.
• Collaboration: Collaborate with cross-functional teams, including FLEXCUBE consulting, data scientists, analysts, and business stakeholders, to understand data requirements and deliver actionable insights.
• Mastery of the FLEXCUBE 14.7 backend tables and data model is essential.

Qualifications:

• Bachelors degree in Computer Science, Information Technology, or a related field.
• 5 to 8 Years of proven experience in designing and implementing data solutions within the Hadoop ecosystem.
• Strong expertise in Hadoop components such as HDFS, Sqoop, Unix shell scripting, Python coding and Spark
• Experience with FLEXCUBE integration and data extraction.
• Proficiency in SQL and database systems.
• Knowledge of data modelling and ETL processes.
• Strong problem-solving and analytical skills.
• Excellent communication and teamwork abilities.
• Banking or financial industry experience is a plus.
• Certifications in Hadoop or related technologies are beneficial.