Описание:
Finom is a European tech startup headquartered in Amsterdam that develops an all-in-one financial B2B solution for entrepreneurs. Its mobile-first platform integrates banking functions, accounting, financial management, invoicing, and AI-enabled accounting, and operates across key EU markets.
Задачи:
- Own and extend the offline evaluation suite across products, including datasets, judges, and metrics;
- Build and maintain online quality dashboards covering resolution rate, CSAT, thumbs up/down, LLM-as-judge signals, error rate, and latency;
- Mine failure patterns from real traffic, convert them into regression cases, and propose fixes to Product and domain experts;
- Harden evaluation methodology through judge stability and non-determinism handling;
- Translate metrics into decisions through weekly syncs and clear trade-offs;
- Collaborate closely with AI engineers, Product, and domain experts across the company.
Требования:
- Build end-to-end analyses with Python and SQL;
- Have a solid foundation in statistics, including sampling, hypothesis testing, variance, and noisy metrics;
- Start from the business question rather than the tool;
- Have 3+ years of experience in analyst or data scientist roles, including at least one year in a product context;
- Be curious about and fluent with AI-assisted coding, or genuinely excited to become fluent quickly;
- Nice to have: experience in quality analytics for ML systems such as ranking, recommendations, or classification;
- hands-on experience evaluating LLM applications including RAG, agents, tool use, or judges;
- experience building LLM agents through side projects, toy builds, or personal experiments.
Условия:
- Work in the EU;
- Remote or hybrid work and travel across Europe are available;
- Stock Options Program available to every team member;
- Resources and opportunities for continuous personal and professional development;
- Work & Swim Program with one month in a corporate apartment in Cyprus;
- Equal opportunity employer with support for employee well-being.
#J-18808-Ljbffr
data scientist for AI quality Arbeitgeber: Finom
Finom ist ein innovatives europäisches Tech-Start-up mit Sitz in Amsterdam, das seinen Mitarbeitern die Möglichkeit bietet, in einem dynamischen und unterstützenden Umfeld zu arbeiten. Wir fördern eine Kultur der Innovation und des Wachstums, in der Ihre Ideen geschätzt werden und Sie durch unser umfassendes Weiterbildungsangebot sowie unsere flexiblen Arbeitsmodelle, einschließlich der Möglichkeit, remote oder hybrid zu arbeiten, echte Auswirkungen auf unser Produkt haben können. Darüber hinaus bieten wir einzigartige Vorteile wie unser Work & Swim-Programm, das Ihnen die Möglichkeit gibt, Arbeit und Freizeit in einer inspirierenden Umgebung zu verbinden.
