AI Libraries Developer

Introduction

At IBM Infrastructure & Technology, we build and run the systems that keep the world in motion. Our work spans high-resiliency mainframes and hybrid cloud platforms, along with networking, automation, and site reliability. We deliver the performance, security, and scalability that clients and industries rely on daily. In Infrastructure & Technology, you’ll tackle intricate challenges through curiosity and collaboration. You’ll partner with a worldwide community of colleagues and technologies to create resilient, future-ready solutions that support innovation. With ongoing learning, career advancement, and a team-oriented culture, IBM helps you grow your expertise and influence the infrastructure driving progress.

Your Role And Responsibilities

This role is for an experienced AI Library Developer with strong expertise in AI runtime frameworks and in developing, improving, and optimizing AI libraries. You will join the Power System Performance team and focus on advancing AI frameworks and libraries to fully utilize the capabilities of IBM POWER architecture. Experience tuning AI libraries and workloads for other platforms such as x86 or ARM is also strongly relevant.

As a Developer, You Will

• Work with internal teams and the open-source community to define, design, develop, and verify Power-specific features in AI libraries, including OpenBLAS, ONNXRuntime, PyTorch, vLLM,Ollama and Vector Databases, with an emphasis on CPU kernel development and optimization.
• Make sure CPU-accelerated enhancements are upstreamed and adopted in mainstream OPensource distributions.
• Create and optimize CPU kernels that accelerate AI workloads.
• Conduct performance analysis and tuning using POWER instruction profiling tools.
• Address issues and defects by recreating problems, debugging, proposing solutions, validating them, and collaborating with the community to upstream fixes.
• Assist during customer-critical situations, lead proof-of-concept implementations, and provide technical direction for pre-sales and post-sales engagements.
  
  

To succeed, you need a deep understanding of CPU architecture, Linux-based operating system environments, and AI workload optimization. Experience with software build systems, bring-up, testing, and performance analysis tools is desirable. You will work within a globally distributed team.

Required Technical And Professional Expertise

• Strong understanding of Computer Architecture, Operating Systems, Compilers, and Runtimes.
• 3+ years of experience in C/C++ and Python development.
• 1+ year experience in assembly language and low-level debugging.
• 1+ year experience in AI workload optimization.
• Experience with open-source development tools such as Git, JIRA, or Bugzilla.
• Hands-on experience with AI libraries: OpenBLAS, ONNXRuntime, PyTorch, TensorFlow, Vector DBs.
• Solid foundation in Linear Algebra, Eigenvalues, and Numerical Computing
  
  

Preferred Technical And Professional Experience

• Experience in low-level programming related to OS interaction, memory management, and threading.
• Experience in GPU programming (CUDA/OpenCL) and AI workload optimization.
• Ability to debug, trace, and profile code to identify performance and functional issues.
• Familiarity with IBM AIX, Linux on POWER, or Z systems.
• Contributions to open-source projects or active involvement in community mailing lists.
• Development experience with core libraries such as Glibc, libm, or PMDK.
• Exposure to compiler technologies (LLVM, MLIR) and graph optimization.