Spark Developer

Job Description:

• A day in the life of an Infoscion
• As part of the Infosys delivery team, your primary role will be to collaborate with the client to resolve quality assurance issues and ensure consistently high customer satisfaction
• You will interpret requirements, create and review designs, validate the architecture, and help deliver high-quality service offerings to clients within the technology domain
• You will support project estimation by providing inputs for solution delivery, conduct technical risk planning, perform code reviews, and review unit test plans
• You will lead and guide your teams to develop optimized, high-quality code deliverables, while driving continual knowledge management and ensuring adherence to organizational guidelines and processes
• You will be a key contributor to building efficient programs and systems, and if you believe you are the right fit to help our clients progress through their next phase in their digital transformation journey, this is the place for you
• If you believe you are the right fit to help our clients progress through their next phase in their digital transformation journey, this is the place for you

Key Responsibilities:

• Minimum 2 years of experience and strong knowledge in Java and related frameworks
• Expertise in building robust, scalable, and maintainable applications using Java and Spark
• Ability to write clean, maintainable, and efficient Java code by following best practices
• Deep understanding of Java core and Java EE concepts, including JVM internals such as class loading and memory management
• Good knowledge of fundamental Data Structures, Collections, and their usage
• At least 6 years of experience designing and developing large-scale distributed data processing pipelines using Apache Spark and related technologies
• Expertise in Spark Core, Spark SQL, Batch processing, and Spark Streaming using the Spark Java API
• Expertise in Kafka messaging producer and consumer operations, including offset management for real-time data streaming with Apache Kafka and Confluent Kafka
• Experience with Hadoop HDFS, Hive, and other BigData technologies
• Familiarity with AWS Glue, EMR, etc
• is good to have
• Familiarity with data warehousing and ETL concepts and techniques
• Expertise in database concepts and SQL/NoSQL operations
• UNIX shell scripting will be an added advantage for scheduling and running application jobs
• At least 5 years of experience in Project development lifecycle activities and maintenance support projects
• Work in an Agile environment and participate in scrum, including daily standups, sprint planning, reviews, and retrospectives
• Understand project requirements and translate them into technical solutions that meet project quality standards
• Ability to work in a team across diverse, multiple stakeholder environments, collaborating with upstream and downstream functional teams to identify, troubleshoot, and resolve data issues
• Strong problem-solving and good analytical skills
• Excellent verbal and written communication skills
• Experience and desire to work in a global delivery environment
• Stay up to date with new technologies and industry trends in development

Preferred Skills:

Technology->Data Engineering->Spark,Technology->Java->Apache->Spark