Spark Developer

Job Description:

• Become part of a data-driven team where your experience in distributed processing helps convert complex datasets into actionable, meaningful insights
• Work closely with engineers, analysts, and stakeholders to create dependable, scalable data solutions with Spark—enabling faster decision-making and improved customer outcomes
• Take ownership of assigned deliverables, enhance performance, and bring clarity to unclear requirements through structured analysis and well-considered implementation
• If you like tackling large-scale data challenges, optimizing data pipelines, and collaborating in an environment that prioritizes learning and continuous improvement, you’ll build deeper technical expertise while delivering a visible impact across projects and teams

Key Responsibilities:

• Key Responsibilities
• Design, develop, and maintain scalable data processing jobs using Spark for batch and or near real-time workloads
• Analyze large datasets to spot trends, anomalies, and data quality issues; implement validation and reconciliation checks
• Improve Spark application performance through partition tuning, caching strategies, memory optimization, and execution plan refinement
• Partner with cross-functional teams to convert business needs into technical solutions and clearly defined deliverables
• Build and maintain reliable error handling, logging, and monitoring capabilities to support stability and faster troubleshooting
• Participate in code reviews, adhere to engineering best practices, and contribute to reusable components and team standards
• Support deployments and production-related issues by performing root cause analysis and applying preventive fixes

Technical Requirements:

• Minimum Qualifications
• Bachelor s degree or equivalent in Engineering Technology Computer Science or related field BTech BE MSc or equivalent
• 3 5 years of experience working on data engineering or big data processing initiatives
• Hands-on experience building and maintaining Spark based data processing solutions
• Strong understanding of distributed computing concepts and data processing fundamentals
• Ability to work independently on assigned modules and collaborate effectively within a team
• Preferred Qualifications
• Master s degree MTech MCA or equivalent in a relevant discipline
• Proven experience delivering end-to-end Spark pipelines including development, testing, and production support
• Experience improving job performance and stability through Spark tuning and structured troubleshooting practices
• Familiarity with building reusable frameworks and components to standardize Spark development across projects
• Strong communication skills to explain technical trade offs and align solutions with stakeholder expectations
• Good to have skills
• Hadoop Hive Kafka Airflow Delta Lake

Additional Responsibilities:

• Infosys is a global leader in next generation digital services and consulting
• We enable clients in more than 50 countries to navigate their digital transformation
• With over four decades of experience in managing the systems and workings of global enterprises we expertly steer our clients through their digital journey
• We do it by enabling the enterprise with an AI powered core that helps prioritize the execution of change
• We also empower the business with agile digital at scale to deliver unprecedented levels of performance and customer delight
• Our always on learning agenda drives their continuous improvement through building and transferring digital skills expertise and ideas from our innovation ecosystem
• Infosys provides equal employment opportunities to applicants and employees without regard to race color sex gender identity sexual orientation religious practices and observances national origin pregnancy childbirth or related medical conditions status as a protected veteran or spouse family member of a protected veteran or disability

Preferred Skills:

Technology->Data Engineering->Spark->SparkSQL,Technology->Java->Apache->Spark