AA
Listed on Aleph Alpha’s own careers site. You apply with them directly — we never stand between you and the employer.
What this role is
Senior AI Researcher at Aleph Alpha working on pre-training foundation models for European markets, focusing on architecture design, training optimization, and scaling large transformer models across thousands of GPUs. Ideal for experienced ML researchers who combine rigorous experimental thinking with strong software engineering and want hands-on impact on next-generation model development.
Our summary, not Aleph Alpha’s wording. The full posting is on their site.
What they ask for
Required
- Proficiency in Python and PyTorch-based training workflows
- Strong track record in ML research through shipped models, open-source contributions, or published research
- Strong mathematical foundation in optimization and training dynamics
- Deep understanding of transformer training dynamics and large distributed training
- Ability to design rigorous experiments and translate empirical observations into training decisions
- Hands-on experience pre-training models 7B+ parameters on 100+ GPU clusters
- Strong software engineering practices including maintainable, well-tested code
- Ability to implement complex model architectures and debug across model code, training dynamics, and distributed systems
- Effective collaboration within research and engineering teams
- Ability to work in Germany and collaborate on-site regularly in Heidelberg
Nice to have
- Hands-on experience training LLMs or multimodal models using distributed frameworks like Megatron-LM, DeepSpeed, or torchtitan
- Familiarity with scaling laws, hyperparameter transfer, or methods predicting large-scale behavior from proxy runs
- Experience profiling distributed jobs and diagnosing training anomalies like loss spikes or numerical instability
- Exposure to sparse training approaches like Mixture-of-Experts and their systems trade-offs
- Top-tier publications (NeurIPS, ICML, ICLR) or impactful shipped technical work
- Strong curiosity about hardware and systems constraints at scale