Your key responsibilities
- Platform Administration & Governance – Create and manage clusters, cluster policies, and pools; schedule DBR upgrades; configure VNet-injected workspaces, SCIM user/group provisioning, and secret scopes; monitor jobs, audit logs, and system tables for health & cost anomalies.
- Unity Catalog Stewardship – Stand up metastores, catalogs, and schemas; implement object ownership, row/column security, data lineage, and privilege delegation.
- ETL & Delta Live Tables Support – Partner with data engineers to build and optimize Spark/Delta pipelines, streaming jobs, and orchestration in Databricks Workflows.
- Security & Data Privacy – Integrate AAD SSO, network security controls
- Automation & IaC – Implement Terraform/Databricks Terraform provider, Databricks CLI, and CI/CD pipelines for workspace and Unity Catalog objects.
- Cost Optimisation & Observability – Tag resources, set auto-termination, right-size clusters
- Documentation & Knowledge Transfer – Maintain runbooks, SLA playbooks, and deliver platform onboarding sessions.
Skills and attributes for success
- Databricks Platform Administrator Accreditation
- Databricks Certified Data Engineer Professional
- Databricks Lakehouse Fundamentals Accreditation
- Microsoft Azure Administrator Associate (AZ-104)
- (Preferred) Microsoft Azure Data Engineer Associate (DP-203) or successor certification
Nice-to-Have
- Immuta implementation or comparable data-privacy platform experience.
To qualify for the role, you must:
- 5+ yrs administering cloud big-data platforms, 2+ yrs Azure Databricks
- Proven track record supporting Spark ETL and ML workloads at scale.
- Deep knowledge of Apache Spark 3.x, Delta Lake, Databricks REST API
- Azure core services (ADLS Gen2, Key Vault, VNets)
- Scripting/IaC: Python, PowerShell/Bash, Terraform.
- Hands-on Unity Catalog privilege model, lineage, and audit tables.
- Excellent incident-management, documentation, and stakeholder-communication skills.
You get to work with inspiring and meaningful projects. Our focus is education and coaching alongside practical experience to ensure your personal development. We value our employees and you will be able to control your own development with an individual progression plan. You will quickly grow into a responsible role with challenging and stimulating assignments. Moreover, you will be part of an interdisciplinary environment that emphasizes high quality and knowledge exchange. Plus, we offer:
- Support, coaching and feedback from some of the most engaging colleagues around
- Opportunities to develop new skills and progress your career
- The freedom and flexibility to handle your role in a way that’s right for you
EY exists to build a better working world, helping to create long-term value for clients, people and society and build trust in the capital markets.