Software Engineer, PySpark

What you'll do

In your new role, you'll be working within a feature team to engineer software, scripts and tools, as well as liaising with other engineers, architects and business analysts across the platform.

You'll also be:

• Producing complex and critical software rapidly and of high quality which adds value to the business
• Working in permanent teams who are responsible for the full life cycle, from initial development, through enhancement and maintenance to replacement or decommissioning
• Collaborating to optimise our software engineering capability
• Designing, producing, testing and implementing our working software solutions
• Working across the life cycle, from requirements analysis and design, through coding to testing, deployment and operations

The skills you'll need

To take on this role, you'll need a background in software engineering, software design, and architecture, and an understanding of how your area of expertise supports our customers.

You'll also need:

• Four to eight years of experience with AWS services such as EMR, Glue, and Athena
• At least four years of experience in Python and PySpark
• Experience in multiple programming languages or low code toolsets
• Experience of DevOps and Agile methodology and associated toolsets
• A background in solving highly complex, analytical and numerical problems
• Experience of implementing programming best practice, especially around scalability, automation, virtualisation, optimisation, availability and performance