Skip to main content
CareerApp

Development Architect (f/m/d) - AI Foundation Model Training and Serving

SAP

Potsdam, DE, 14469 · full time · Senior

Listed on SAP’s own careers site. You apply with them directly — we never stand between you and the employer.

What this role is

Design and lead the AI infrastructure for a distributed platform enabling foundation model training and deployment across enterprises. This role suits architects with deep expertise in large-scale ML systems who can bridge research, product, and engineering teams while navigating complex federated environments.

Our summary, not SAP’s wording. The full posting is on their site.

Skills this role names

Log in to see which of these are already on your profile.

What they ask for

Required

  • 8+ years architecting AI and foundation model solutions
  • Hands-on experience designing distributed training systems with cluster orchestration and parallelism strategies
  • Knowledge of foundation model fine-tuning including RLHF, DPO, and distillation
  • Proficiency in Python and at least one other programming language
  • Ability to translate business and research requirements into scalable technical designs
  • Strong collaboration and communication skills with technical stakeholders

Nice to have

  • Experience with federated training across organizational boundaries
  • Working knowledge of inference serving systems like vLLM
  • Understanding of serving trade-offs including batching, KV cache, quantization, and latency versus cost
  • Hands-on experience with evaluation pipelines and serving at scale

Turn on analytics and we load Google Analytics: Google gets the pages you open and what you do here — searches, jobs you view, jobs you apply to — and sets its own cookies. Leave it off and the only cookies we set are your login, your theme, and this answer. Accept All also records a yes to advertising, which nothing uses yet. Privacy Policy.