Senior Test Manager & Quality Engineer 100% (f/m/d)

pAt Julius Baer, we celebrate and value the individual qualities you bring, enabling you to be impactful, to be entrepreneurial, to be empowered, and to create value beyond wealth. Let’s shape the future of wealth management together. /pJoin our ML AI ART as a Test Manager Quality Engineer responsible for testing AI ML solutions throughout their life-cycle. Focus will be on assessing the quality of developed solutions already in the development phase and give active feedback/collaborate with the ML Engineer teams. br/br/You are the gatekeeper before a solution goes into evaluation by Model Risk Management and also before Go-Live. You will also own the testing and quality assurance of technical components that are provided by the platform team such as model APIs, agent repository and other components. implementation, and execution of our test automation frameworks, covering both traditional software componentsppbbYOUR CHALLENGE /b /b /p /plipEnsure delivery quality and proper testing of AI use cases /p /lilipDefine and evolve the technical testing approach and framework architecture for the ML AI ART, aligned with the Bank's Test Strategy and Test Policy /p /lilipDesign reusable, scalable testing patterns (page objects, API clients, test data builders) that other engineers across squads can adopt, ensuring technical consistency of testing across the ART /p /lilipAnalyse and evaluate requirements, Features, and Stories for testability during PI Planning, Backlog Refinement, and Iteration Planning /p /lilipDerive test cases from technical and risk analysis of both functional and non-functional requirements (reliability, performance, security, usability, robustness), selecting appropriate test techniques and automation scope based on risk, coverage goals, and ROI /p /lilipAutomate identified test cases using Python-based frameworks — Playwright-Python for UI, requests + pytest for APIs, Behave or pytest-bdd for BDD/Gherkin — applying clean code principles, reusability, readability, and stability /p /lilipDesign and implement AI/ML-specific test cases: evaluation pipelines for LLM outputs /p /lilipIntegrate and orchestrate automated tests in GitLab CI/CD pipelines, including merge request pipelines, GitLab runner /p /lilipPlan, schedule, and trigger automated test executions across environments (DEV, INT, UAT, pre-PROD) including regression suites, smoke tests, release executions, and on-demand runs tied to merge requests and PI milestones /p /lilipTriage execution results, raise defects in Jira with evidence (logs, traces, screenshots, videos), and communicate quality signals to the squad and Product Owner /p /lilipContribute actively to PI Planning, System Demos, Inspect Adapt, and other SAFe ceremonies as part of the ML AI ART /p /lilipPrepare test data, ensuring synthetic or anonymised data is used wherever possible to meet confidentiality expectations /p /lippbbYOUR PROFILE /b /b /p /plipHands-on experience integrating and executing tests for AI solutions and/or large scale data projects /p /lilipSolid grasp of Git and version control workflows, clean code principles, and code review culture /p /lilipWorking knowledge of Docker; familiarity with Kubernetes basics (jobs, namespaces) /p /lilipExposure to testing AI/ML systems, or strong motivation to develop this expertise: evaluation of LLM outputs, handling non-deterministic responses, evals for RAG and agentic workflow /p /lilipUnderstanding of API design, microservices, event-driven architectures, and authentication layers /p /lilipSound understanding of SAFe and DevOps principles; experience operating in an Agile Release Train is a plus /p /lilipExperience with Jira for Story/Feature tracking and test management integration (Xray, Agile Hive) /p /lilipDemonstrated end-to-end thinking — connecting user journeys, data flows, authentication layers, and system boundaries /p /lilipComfortable working within an established Test Strategy, collaborating with Test Managers on execution planning, reporting, and compliance /p /lilipCollaborative team player with strong ownership takes automation problems from analysis to execution to resolution with minimal supervision /p /lilipBachelor's or Master's degree in Computer Science, Engineering, or a related field /p /lilipMinimum 5–7 years with data ML platforms and their Quality Assurance and/or Testing with substantial hands-on Python experience, including demonstrated framework design, ownership, and test execution at scale (not only script-level contributions) /p /lilipExperience in a regulated environment (financial services, healthcare, pharma) strongly preferred /p /lilipCertifications in ISTQB (Foundation as baseline) /p /lilipSAFe (SP, SSM, or equivalent), or DevOps disciplines are a plus /p /lilipExposure to AI/ML systems through testing, development, or applied projects is a strong plus; appetite to develop deep AI/ML testing expertise is essential /p /lilipStrong communicator able to work effectively with engineers, Product Owners and Scrum Masters /p /lilipGood organisational skills, structured and reliable /p /lilipFluency in English; German is a plus /p /lipWe are looking forward to receiving your full job application through our online application tool. /p