platform engineer Azure Databricks

Описание: EPAM provides enterprise software products, open source solutions, and accelerators.

Задачи

• Administer and manage Azure Databricks and Data Lake Storage Gen2 workspaces
• Implement and enforce access control using RBAC and Entra ID
• Apply Databricks governance concepts, including Unity Catalog, data lineage, and access policies
• Develop automation scripts and REST API integrations for environment configuration and monitoring
• Monitor platform health, ensure operational reliability, and handle incident response
• Collaborate with stakeholders to align platform standards and governance practices
• Troubleshoot and resolve platform issues, optimizing performance and efficiency
• Document processes and maintain platform best practices

Требования

• Strong experience with Microsoft Azure services, particularly Azure Databricks and Data Lake Storage
• Proficiency in Azure access management with RBAC and Entra ID
• Knowledge of Databricks governance, including Unity Catalog for security and data lineage
• Hands-on experience using Terraform for deploying and managing Databricks infrastructure
• Basic Python programming skills for automation and scripting
• Familiarity with REST APIs for system configuration
• Understanding of DevOps principles, including observability, monitoring, and incident response
• Experience working in enterprise environments, ideally global organizations
• Strong analytical and problem-solving abilities
• Nice to have: familiarity with Agile methodologies (Scrum, SAFe), experience in Databricks administration such as job orchestration and cluster policy design, contributions to shared automation or governance frameworks, knowledge of infrastructure-as-code tools such as Terraform and ARM templates, exposure to CI/CD pipelines and DevOps toolchains.

Условия

Remote or hybrid working mode in Poland.