Senior QA Automation Engineer, Python, Selenium, Pytest

Responsibilities

• Design comprehensive test architecture – plan unit, integration, E2E, and semantic validation test suites that cover the full pipeline from profile intake through roadmap generation; define coverage targets and acceptance criteria
• Build semantic validation harnesses for AI outputs – design golden-set test cases (5–8 CISO-approved reference profiles) that measure AI stage precision/recall, rigor-tier correctness, floor-control invariants, traceability completeness, and run-to-run stability; a semantic regression blocks merge
• Implement access-control testing – design automated probes at API and database layers that verify cross-tenant isolation; simulate compromised sessions and verify RLS policies enforce tenant boundaries
• Design and maintain CI/CD quality gates – build automated test runners that execute on every commit: unit tests, integration tests, schema validation, migration guards, image scanning, access-control probes; red builds block merge
• Lead test automation practices – expand automation frameworks and practices; identify opportunities for improving test processes; recommend tools and technologies for testing efficiency
• Collaborate across the team – serve as the QA voice in technical design reviews; flag testability issues early; work with the AI/LLM Lead to define what "correct" means for each pipeline stage
• Mentor junior test engineers – guide the team on test design, semantic validation, and CI/CD best practices; share knowledge on testing AI systems where reproducibility is critical
• Own test documentation and reporting – maintain clear test plans, results, and traceability matrices; report test coverage and quality metrics to leadership; communicate blockers and risks transparently

Requirements

• 5+ years of hands‑on software QA with a track record of

• Test strategy, planning, execution, and maintenance
• Comprehensive test documentation and traceability
• Advanced test automation (custom frameworks, advanced scripting)
• 3+ years with automated testing tools – Selenium, Pytest, or equivalent; ability to write custom testing frameworks
• Advanced proficiency in a programming language relevant to test automation:
• Python (primary for this engagement; Pyset, async testing)
• Or Java, C#, Go
• Deep knowledge of databases and SQL – execute complex data validation, verify multi‑tenant isolation at the DB layer, test RLS policies
• CI/CD pipeline expertise – understand how tests integrate into automated deployment workflows; experience optimizing test execution for speed and reliability
• Understanding of Agile/Scrum methodologies – ability to drive QA strategies in rapid, iterative development cycles
• Proficiency in defect tracking (Jira or equivalent)
• Proven leadership – mentor junior engineers, advocate for quality standards, drive process improvements
• Exceptional communication skills – articulate complex technical issues to engineers, product, and stakeholders
• Self‑motivated and detail‑oriented – work independently under time pressure, manage multiple priorities
• Exceptional English proficiency – work effectively with distributed, global teams.
• Core Competencies

Demonstrates expertise in test strategy, automation, and CI/CD processes, with a strong focus on semantic validation and comprehensive test documentation.

Proven ability to mentor teams and communicate effectively across technical and non‑technical stakeholders.

• Hard Skills
• Test Strategy
• Test Documentation
• Advanced Test Automation
• Python
• Selenium
• Pytest
• SQL
• CI/CD
• Defect Tracking
• Semantic Validation
• Soft Skills
• Exceptional Communication
• Mentoring
• Self‑Motivated
• Detail‑Oriented
• Industry Keywords
• Quality Assurance
• Test Automation
• Agile
• Multi‑Tenant Isolation
• AI Testing
• Tools & Technologies
• Jira
• Automated Testing Tools
• Custom Testing Frameworks
• #J-18808-Ljbffr