Senior Software Engineer

Senior Software Engineer Overview

A well-funded AI engineering company is seeking a senior software engineer to help deploy, extend, and improve a leading open-source large language model inference engine. The role sits across two important efforts: one focused on scaling inference and another aimed at high-assurance and regulated environments. This is a remote position based in the UK and offers a competitive salary.

What you will be doing

• Deploying open-weight models on the inference platform, then adding instrumentation and monitoring so their behaviour and performance can be tracked effectively.
• Building new capabilities in the engine to support emerging hardware architectures and accelerator designs.
• Adapting the engine for use in regulated settings by strengthening accuracy, explainability, and accountability features.
• Improving inference efficiency through careful optimisation of latency, throughput, and hardware utilisation.
• Working upstream with the relevant open-source community so improvements are shared back into the core project.

What the employer is looking for

• Senior-level experience with Python, together with strong low-level engineering skills in languages such as C, C++, Rust, or CUDA.
• Evidence of direct contributions to a major inference, serving, or machine-learning infrastructure project, or a comparable open-source or infrastructure codebase.
• A strong understanding of the internal mechanics of LLM inference, including KV caching, batching strategies, and quantisation techniques.
• Prior experience contributing changes back to active open-source communities.
• Experience improving software performance on hardware accelerators such as GPUs or TPUs.
• Genuine enthusiasm for using AI-assisted development tools, including LLMs and agents, as part of the engineering workflow.
• Desirable experience includes work in regulated environments, involvement in AI safety, and deeper knowledge of MLOps or CI/CD.

Additional details

• The organisation is described as well funded and focused on AI engineering.
• The role is connected to both scaling infrastructure and a high-assurance/regulated use case.
• Applicants who feel they are a strong match are encouraged to contact Charles Duran at IC Resources and apply through the advertised application route.

Degree Requirement: Not Specified

Visa Sponsorship May be