Your missionYou will make Lyceum's AI inference platform reliable, secure, and scalable - ensuring it performs under pressure as we grow to thousands of concurrent users. While others on the team expand what the platform can do, your job is to make sure it keeps working, fails gracefully, and gets faster over time.Your focusScalability: Architect and implement the systems that allow our inference platform to scale to thousands of concurrent users. This includes request routing, load balancing, autoscaling, and resource scheduling across GPU clusters.Reliability and observability: Build robust monitoring, alerting, and incident response tooling. Design for graceful degradation, automatic recovery, and minimal downtime.Performance engineering: Profile and optimise the full inference path from request ingestion through model execution to response delivery. Identify and eliminate bottlenecks at every layer.Infrastructure evolution: Evaluate and integrate open-source inference frameworks and tooling (Dynamo, vLLM, Triton, etc.) where they improve throughput, latency, or stability of the serving stack.Your KPIsPlatform uptime and availability (SLA adherence)P50/P95/P99 latency and throughput under loadTime-to-detection and time-to-resolution for incidentsScalability milestones (concurrent users, requests per second, GPU utilisation)Your profileWe consider candidates from diverse backgrounds, with a deep love for technical challenges and the desire to take on ownership beyond what's reasonably expected.Requirements3+ years of experience in backend, infrastructure, or systems engineeringStrong proficiency in Go and PythonExperience building or operating a model serving platform or ML platformSolid understanding of systems performance - profiling, benchmarking, and optimising latency and throughputFamiliarity with observability tooling (Prometheus, Grafana, OpenTelemetry, or similar)Understanding of security fundamentals - network isolation, authentication, encryption, multi‑tenancyNice to haveExperience with NVIDIA Dynamo or similar inference orchestration/routing frameworksHands‑on experience with GPU serving infrastructure (vLLM, Triton, TensorRT‑LLM)Experience with Kubernetes in a production environment (deployment, networking, resource management)Experience operating at scale (10k+ RPS, multi‑region, multi‑cluster)Comfortable working on‑call or in incident response when things breakWhy us?Outstanding team: Work with some of the best engineers in the world, coming from hedge funds, big tech, AI startups and top universitiesOnce in a lifetime opportunity: Early‑stage company in the fastest‑growing market in the worldOwnership: Shape how European AI companies access GPU computeEuropean mission: Build sovereign, GDPR-compliant AI infrastructure for the next generation of deep‑techFind Jobs in Switzerland on Arbeitnow #J-18808-Ljbffr
Member of Technical Staff – AI Inference platform in Zürich Arbeitgeber: Lyceum
Als Compute Markets Associate bei uns erwartet Sie eine herausragende Arbeitsumgebung, in der Sie mit einem talentierten Team von Ingenieuren zusammenarbeiten, die aus Hedgefonds, großen Technologieunternehmen und führenden Universitäten stammen. Wir bieten Ihnen die Möglichkeit, in einem schnell wachsenden Markt zu arbeiten und aktiv an der Gestaltung der europäischen AI-Infrastruktur mitzuwirken. Darüber hinaus fördern wir Ihre persönliche und berufliche Entwicklung durch innovative Projekte und ein unterstützendes Arbeitsklima, das auf Zusammenarbeit und Kreativität setzt.
