h3YOUR MISSION /h3pYou will make Lyceum's AI inference platform reliable, secure, and scalable - ensuring it performs under pressure as we grow to thousands of concurrent users. While others on the team expand what the platform can do, your job is to make sure it keeps working, fails gracefully, and gets faster over time. /ph3Your focus /h3ulliScalability: Architect and implement the systems that allow our inference platform to scale to thousands of concurrent users. This includes request routing, load balancing, autoscaling, and resource scheduling across GPU clusters. /liliReliability and observability: Build robust monitoring, alerting, and incident response tooling. Design for graceful degradation, automatic recovery, and minimal downtime. /liliPerformance engineering: Profile and optimise the full inference path from request ingestion through model execution to response delivery. Identify and eliminate bottlenecks at every layer. /liliInfrastructure evolution: Evaluate and integrate open-source inference frameworks and tooling (Dynamo, vLLM, Triton, etc.) where they improve throughput, latency, or stability of the serving stack. /li /ulh3Your KPIs /h3ulliPlatform uptime and availability (SLA adherence) /liliP50/P95/P99 latency and throughput under load /liliTime-to-detection and time-to-resolution for incidents /liliScalability milestones (concurrent users, requests per second, GPU utilisation) /li /ulh3YOUR PROFILE /h3pWe consider candidates from diverse backgrounds, with a deep love for technical challenges and the desire to take on ownership beyond what's reasonably expected. /ph3Requirements /h3ulli3+ years of experience in backend, infrastructure, or systems engineering /liliStrong proficiency in Go and Python /liliExperience building or operating a model serving platform or ML platform /liliSolid understanding of systems performance - profiling, benchmarking, and optimising latency and throughput /liliFamiliarity with observability tooling (Prometheus, Grafana, OpenTelemetry, or similar) /liliUnderstanding of security fundamentals - network isolation, authentication, encryption, multi-tenancy /li /ulh3Nice to have /h3ulliExperience with NVIDIA Dynamo or similar inference orchestration/routing frameworks /liliHands-on experience with GPU serving infrastructure (vLLM, Triton, TensorRT-LLM) /liliExperience with Kubernetes in a production environment (deployment, networking, resource management) /liliExperience operating at scale (10k+ RPS, multi-region, multi-cluster) /liliComfortable working on-call or in incident response when things break /li /ulh3WHY US? /h3ulliOutstanding team: Work with some of the best engineers in the world, coming from hedge funds, big tech, AI startups and top universities /liliOnce in a lifetime opportunity: Early-stage company in the fastest-growing market in the world /liliOwnership: Shape how European AI companies access GPU compute /liliEuropean mission: Build sovereign, GDPR-compliant AI infrastructure for the next generation of deep-tech /li /ul #J-18808-Ljbffr
Member of Technical Staff – AI Inference platform Arbeitgeber: Lyceum Switzerland
Lyceum bietet eine herausragende Arbeitsumgebung, in der Sie mit einigen der besten Ingenieure der Welt zusammenarbeiten können. Unser Team fördert eine Kultur des Eigentums und der Verantwortung, während wir an der Spitze des schnellstwachsenden Marktes arbeiten. Darüber hinaus bieten wir Ihnen die Möglichkeit, an innovativen Projekten zu arbeiten, die die europäische KI-Infrastruktur revolutionieren und gleichzeitig Ihre berufliche Entwicklung unterstützen.
