ML Observability Engineer in Berlin

AI SaaS | ML Observability | MLOps | ML Reliability | AI Infrastructure

Our client, a growing AI SaaS company based in Berlin, is looking for an ML Observability Engineer to build the systems that give engineering teams visibility into model performance, infrastructure behaviour, latency, drift, and production failures.

You’ll work at the intersection of MLOps, Site Reliability Engineering, and ML Engineering, helping teams understand not just whether their services are running—but whether their models are performing as expected.

What You'll Work On

• Build observability systems for production ML workloads
• Monitor model performance, drift, latency, errors, and resource utilisation
• Develop ML monitoring and reliability tooling in Python
• Build telemetry pipelines using OpenTelemetry
• Create metrics, dashboards, and alerting with Prometheus
• Integrate observability across Kubernetes-based ML infrastructure
• Track experiments, deployments, and model versions using MLflow
• Define meaningful reliability indicators for production ML systems
• Detect degradation and anomalous model behaviour before it impacts usersImprove incident investigation and root-cause analysis across models and infrastructure
• Collaborate with ML, MLOps, and Platform Engineers to improve production reliability

Core Skills

• 4+ years in MLOps, ML Infrastructure, SRE, Platform Engineering, or similar roles
• Strong understanding of production ML systems and observability

Nice to Have

• Grafana
• Evidently / Arize / WhyLabs or similar ML observability tooling