Senior AI Researcher- Pre-training (f/m/d) in Heidelberg, Unterensingen

Senior AI Researcher- Pre-training (f/m/d)The role centers on owning how a large language model is trained: the optimizer, learning schedule, starting weights, and architecture choices that decide whether a run converges and stays stable. A strong candidate has already pre-trained models of 7B parameters or more on clusters of 100+ GPUs, reasons comfortably about optimization math, and writes clean, tested PyTorch. They can also track down tricky failures such as loss spikes and distributed bugs, then turn noisy experiment results into clear decisions.How it fits the AI eraThe work is building the AI itself, so the job is shaped by how fast model design and training methods keep changing. Tools that help write code and run experiments can speed up routine tasks, but judgment about why a run diverged or which scaling bet is worth thousands of GPUs still rests with the researcher. Careful experiment design, honest reading of weak evidence, and teamwork across data, evaluation and hardware groups stay human.How it builds AI experienceSomeone in this role would gain hands-on experience with training runs at a scale few teams in Europe reach, plus work on models aimed at German language and regulated, high-stakes uses. To prepare, a candidate can practice with open training frameworks such as Megatron-LM, DeepSpeed or torchtitan, run small scaling-law studies, and write up what they learn on public projects.Worth showingPre-training 7B+ models at scaleScaling laws and hyperparameter transferDebugging loss spikes and divergencePublished research or open-source workThis is our own read, written from the employer's posting and the company's Spotlight. The employer's posting is the source of truth for the role.About Aleph AlphaPer the company, Aleph Alpha builds sovereign large language models and AI solutions for European enterprises and public institutions. #J-18808-Ljbffr