IN

Pyspark_Spark_Consultant

Infosys Limited
Bangalore Posted 13 Oct 2026
FULL TIME
Performance Tuning
Scala
Apache Spark
Pyspark
Etl Development
+2 more

Job Description

Job Overview:

  • We are seeking a proficient Spark Scala Developer who possesses extensive experience in big data technologies, data engineering, and distributed data processing.
  • The selected candidate will be tasked with the design, development, and optimization of scalable data pipelines using Apache Spark with Scala, while handling large datasets in both cloud and on-premise settings.
  • This position demands hands-on experience in data processing, ETL development, performance optimization, and collaboration with cross-functional teams to deliver superior data solutions.

Primary Duties:

  • A typical day for an Infoscion involves
  • As a member of the Infosys consulting team, your main responsibility will be leading engagement efforts to provide high-quality, value-driven consulting solutions for clients at various stages, from problem identification to diagnosis, solution design, development, and deployment.
  • You will evaluate proposals generated by consultants, offering guidance and analyzing the solutions devised to resolve client business challenges, identifying potential risks and issues.
  • Your role will involve recognizing change management needs and suggesting a structured approach to clients for managing change through various communication methods.
  • Additionally, you will mentor and formulate a vision for the team, delivering subject matter training in your areas of expertise, while motivating and inspiring team members with timely feedback and recognition for outstanding performance.
  • You will play a vital role in unit-level and organizational initiatives aimed at delivering high-quality, value-adding consulting solutions to clients, in accordance with the organization's guidelines and processes.
  • If you believe you are the right fit to assist our clients in navigating their next steps in their digital transformation journey, this opportunity is for you.

Technical Skills Required:

  • Core skills include Domain Finacle Core Functional, Finacle Core WMS, Grand Master Technology, Big Data, Data Processing, Spark Technology, and Functional Programming with Scala.
  • Additional core skills encompass Big Data, Data Processing, Spark Technology, Functional Programming with Scala, Java, and Apache technologies.

Supplementary Responsibilities:

  • Strong understanding of software configuration management systems.
  • Solid business acumen, strategic insight, and cross-industry thought leadership.
  • Awareness of the latest technological advancements and industry trends.
  • Excellent logical thinking and problem-solving abilities, coupled with a collaborative spirit.
  • Knowledge of two or three industry domains.
  • Comprehension of financial processes relevant to various projects and available pricing models.
  • Client-facing proficiency.
  • Familiarity with SDLC and agile methodologies.
  • Project and team management expertise.

Desirable Skills:

  • Technology -> Big Data - Data Processing -> PySpark
  • Technology -> Big Data - Data Processing -> Spark
  • Technology -> Functional Programming -> Scala
Join WhatsApp Channel