About The Role
Rex.zone is hiring Germany-based AI Generalist Trainers to support large language model evaluation across RLHF and LLM evaluation workflows. You will assess, rank, and QA model outputs in English and German while following annotation guidelines compliance and writing clear rationales that improve training data quality and model performance improvement.
Rex.zone is hiring Germany-based AI Generalist Trainers to support large language model evaluation across RLHF and LLM evaluation workflows. You will assess, rank, and QA model outputs in English and German while following annotation guidelines compliance and writing clear rationales that improve training data quality and model performance improvement.
Responsibilities
- Perform large language model evaluation by assessing and ranking model outputs for relevance, correctness, helpfulness, and safety
- Execute RLHF-style comparisons, including preference ranking and reasoned justification
- Conduct QA evaluation by validating labeled data, auditing consistency, and flagging guideline gaps
- Apply annotation guidelines compliance across English and German tasks with consistent interpretation and documentation
- Handle ambiguous/adversarial prompts, including content safety labeling scenarios
- Write clear rationales that explain decisions, highlight errors, and support model performance improvement
- Track error patterns and provide feedback to improve rubrics and training data quality
- Collaborate asynchronously with project leads to calibrate scoring standards
Basic Qualifications
- Based in Germany and authorized to work per local requirements
- Fluent in English and German (reading, writing, nuanced comprehension)
- Strong analytical judgment and attention to detail
- Comfortable with structured rubrics, spreadsheets/tools, and written feedback
- Able to work full-time remotely with reliable internet and a secure workspace
Preferred Qualifications
- Experience in data labeling, prompt evaluation, QA evaluation, or content safety labeling
- Familiarity with LLM evaluation concepts, RLHF, and common generative AI failure modes
- Experience writing concise rationales and applying decision frameworks at scale
Compensation
Hourly pay range: $30–$50 USD per hour (final rate depends on task complexity, calibration performance, and quality metrics).
#J-18808-Ljbffr
Germany-Based English & German AI Generalist Trainer 2026 May in München Arbeitgeber: Rex.zone
Rex.zone ist ein hervorragender Arbeitgeber, der eine dynamische und unterstützende Arbeitsumgebung in Berlin bietet. Mit einem starken Fokus auf digitale Marketingstrategien und innovativen Technologien fördert das Unternehmen die berufliche Weiterentwicklung seiner Mitarbeiter durch kontinuierliche Schulungen und spannende Projekte. Die remote-freundliche Kultur ermöglicht es den Mitarbeitern, flexibel zu arbeiten und gleichzeitig Teil eines kreativen Teams zu sein, das sich leidenschaftlich für den Erfolg seiner Kampagnen einsetzt.
