We are looking for a BigData Test Automation Specialist to join our team in Zurich. This role focuses on designing and implementing a robust, multi-layered testing strategy for a modern big data platform within the banking sector. You will work with cutting-edge technologies including Trino, Kafka, Iceberg and Dataiku to ensure data quality, platform resilience and overall system integrity.ResponsibilitiesDesign and implement comprehensive test automation strategies for a big data platformDevelop and maintain scalable test frameworksImplement declarative data quality checks for schemasCreate and manage automated tests for complex SQL transformationsTest and validate Hive metastore schemas and data integrityDevelop tests for streaming data pipelines using Kafka and TestcontainersAutomate Dataiku DSS scenarios and integrate them into CI/CD pipelinesBuild and optimize CI/CD infrastructure for efficient big data testingPerform resilience and chaos testing to ensure platform stabilityUse data versioning patterns like Write-Audit-Publish for isolated and safe testingRequirementsStrong experience with Python and the Pytest framework for test automationHands-on experience with big data technologies like Trino, Hive, Kafka or S3Proficiency with data quality and validation toolsExperience with containerization and mocking tools like Docker, TestcontainersProven ability to test streaming applications and event-driven architecturesKnowledge of scripting for cloud object storage interactionExperience with MLOps platforms, preferably DataikuProven experience building and managing CI/CD pipelines (e.g. GitHub Actions, GitLab CI)Familiarity with SQL transformation tools like dbt or SQLMeshUnderstanding of data versioning conceptsFluent in EnglishNice to have Experience in the banking or financial services sector #J-18808-Ljbffr
BigData Test Automation Specialist in Sachseln Arbeitgeber: EPAM Systems
Als Arbeitgeber bieten wir Ihnen die Möglichkeit, in einem dynamischen und innovativen Umfeld zu arbeiten, das sich auf Daten und KI spezialisiert hat. Unsere Unternehmenskultur fördert Zusammenarbeit und Kreativität, während wir gleichzeitig individuelle Wachstumschancen und Weiterbildungen unterstützen. Mit Standorten in Berlin, Frankfurt, Leipzig und München profitieren Sie von einer flexiblen hybriden Arbeitsweise und der Chance, bedeutende Beziehungen zu unseren Kunden aufzubauen und nachhaltige Lösungen zu entwickeln.
