Skip to main content
CareerApp

Member of Technical Staff - Inference Runtime

Modal

San Francisco, CA

$220,000 – $300,000

Listed on Modal’s own careers site. You apply with them directly — we never stand between you and the employer.

What this role is

Modal is seeking a systems engineer to own the container runtime stack that powers inference and training workloads across their AI infrastructure platform. This role involves building low-level systems in Rust and Go, optimizing startup times and memory efficiency, and debugging complex interactions between Linux, containers, GPUs, and distributed systems.

Our summary, not Modal’s wording. The full posting is on their site.

Skills this role names

Log in to see which of these are already on your profile.

What they ask for

Required

  • Strong Linux systems knowledge (processes, virtual memory, filesystems, system calls, scheduling, namespaces, cgroups, signals)
  • Experience building or debugging container runtimes, sandboxes, or low-level infrastructure
  • Strong programming ability in Rust, Go, or another systems language
  • Experience profiling and optimizing systems dominated by memory movement, I/O, or kernel interactions
  • Ability to debug across abstraction boundaries from applications to kernel
  • Ability to turn production problems into well-designed, reliable systems
  • Willingness to own critical infrastructure and work with internal teams and customers

Nice to have

  • gVisor, runsc, runc, OCI runtimes, seccomp, or checkpoint/restore systems experience
  • Linux kernel development, virtualization, sandboxing, kernel modules, or device proxying experience
  • CUDA, ROCm, GPU drivers, accelerator virtualization, or GPU profiling experience
  • RDMA and high-performance networking experience
  • FUSE, EROFS, direct I/O, mmap, or page-cache behavior experience
  • Large-memory or multi-GPU inference and training systems experience
  • Open-source systems software contributions

Turn on analytics and we load Google Analytics: Google gets the pages you open and what you do here — searches, jobs you view, jobs you apply to — and sets its own cookies. Leave it off and the only cookies we set are your login, your theme, and this answer. Accept All also records a yes to advertising, which nothing uses yet. Privacy Policy.