Test Engineer (AI)

ppAt Sixsentix, we don’t just test software – we accelerate innovation. As a leading provider of quality assurance software testing services, we empower global enterprises to deliver high-quality solutions continuously faster and smarter. Our secret? A fearless blend of cutting-edge tools, proven methodologies and an approach that thrives on bold ideas.br/Across all industries, we are the driving force behind some of the most successful digital transformations and platform innovation in Europe and beyond. /pulliImpact from Day One: Your work will directly shape the digitalization of leading companies /liliExpert Collaboration: Work alongside some of the brightest minds in quality assurance and testing /liliGlobal Reach, Local Support: Be part of a diverse, international team with consultants in Switzerland, Serbia, Austria, Germany, Poland and the UAE /liliContinuous Learning: We champion growth—through training, mentorship and a culture that celebrates curiosity /liliInclusive Culture: We value diversity and believe that different perspectives make us stronger /li /ulh3Who we’re looking for /h3pYou are a driven, team-oriented professional who thrives in dynamic environments. You enjoy solving complex problems, collaborating across borders and delivering exceptional value to clients as consultant. At Sixsentix, you will find a place where your ideas matter and your growth is a priority. /ph3What we offer /h3ulliAn environment where you can leverage your previous experience to its fullest and apply new way of working by performing our services using AI and innovative approaches (Agent Business Model) /liliSignificant professional development in the rapidly evolving AI governance space /liliChance to work with cutting-edge AI technologies /liliExposure to emerging regulatory frameworks and industry standards /liliOpportunities to influence AI strategy at the enterprise level /liliEngaging projects across various sectors /liliA community of skilled professionals in Quality Assurance and IT /liliFlexible working hours with the option to work from home /liliTeam events designed to help you connect and share knowledge with your colleagues /liliAttractive fringe benefits, such as extra holidays, sports support, tenure awards and more /li /ulh3Your responsibilities /h3h3AI system validation testing /h3ulliDesign and implement testing frameworks for LLM-based applications, multi-agent systems and RAG pipelines /liliEvaluate AI outputs for conciseness, completeness, semantic accuracy, factual correctness, contextual relevance, tone consistency, bias, safety and compliance /liliImplement governance workflows, risk scoring methods and compliance reporting as part of the overall AI Governance and Risk Management framework at clients /liliSet up continuous monitoring for production AI systems, with automated alerts for anomalies /liliValidate LLM APIs across multiple providers using tools like Postman, REST Assured and pytest /liliIntegrate AI testing suites into CI/CD pipelines for regression testing, benchmarking and deployment gates /liliSet up AI platforms and components in client environments with close collaboration to their IT Security, IAM and infrastructure teams /liliManage version control for prompts and test cases using Git and leverage MLOps tools such as MLflow or Weights Biases /liliManage diverse data formats (JSON, CSV, Parquet, JSONL) and build evaluation datasets from real-world scenarios /liliDesign automated metrics and human-in-the-loop workflows, including inter-annotator agreement processes /liliUnderstand and explain to stakeholders concepts around knowledge bases, vectorization and ingestion /liliCreate and maintain domain-specific evaluation benchmarks and ground truth datasets /li /ulh3Further responsibilities /h3ulliBuild a high-performing team and serve as the subject matter expert towards the client /liliCultivate and strengthen long-term client relationships, focusing on retention and business growth /liliContribute with your knowledge and experience within the Sixsentix test consulting community /li /ulh3Your profile /h3ulliFamiliarity with RAG concepts, vector databases, embedding strategies and multi-agent systems /liliStrong understanding of GenAI challenges such as hallucinations, prompt sensitivity, consistency issues and output variability /liliSolid software testing background in enterprise environments, with the ability to communicate technical concepts to varied stakeholders /liliProficiency in API testing frameworks, CI/CD integration and Git-based collaboration /liliData handling expertise and knowledge of evaluation methodologies for AI performance and risk assessment /liliSelf-starter mindset, comfortable working in ambiguous environments to define new testing methodologies and quality standards /liliPassionate about ensuring AI systems are safe, reliable and beneficial for end users /liliDemonstrate outstanding communication and presentation skills beyond pure technical expertise /li /ulh3Not the right fit? Explore our other open roles and find one that matches you. /h3 /p #J-18808-Ljbffr