Compare your current skills to what this opportunity needs—we'll show you what you already have and what could strengthen your application.
Job Description
Role :
Azure Databricks Platform Admin Location:
Raritan, NJ (Onsite)
Mandatory Skills:
Azure Functions, Databricks Role Overview:
Seeking an experienced Azure Databricks Platform Admin (5-7 years) to manage, secure, and optimize Azure Databricks environments across Dev, QA, and Prod. The ideal candidate has hands-on experience with workspace administration, cluster management, Unity Catalog, security controls, automation, and Azure platform services.
Key Responsibilities:
Administer Databricks workspaces, clusters, jobs, notebooks, and configurations. Configure and manage Unity Catalog, metastores, schemas, and storage credentials.
Implement security controls:
access management, role-based permissions, service principals, secret scopes, Microsoft Entra ID integration. Optimize clusters, autoscaling, runtime versions, and job efficiency. Integrate Databricks with Azure services (ADLS Gen2, Key Vault, Monitor, VNets, Managed Identities). Monitor platform health, logs, job performance, and troubleshoot issues. Support CI/CD and automation via Terraform, Azure DevOps, Databricks
CLI, REST
APIs. Maintain environment standards, documentation, and runbooks. Collaborate with data engineering, architecture, security, and support teams. Drive continuous improvement in operations, security, and cost management.
Required Skills & Qualifications:
5-7 years in cloud platform administration, data operations, or infrastructure support. Hands-on Azure Databricks administration and Unity Catalog experience. Knowledge of Delta Lake, workspace governance, access controls, cluster optimization.
Familiarity with Azure services:
ADLS Gen2, Key Vault, Entra ID, networking, monitoring. Experience with Spark job troubleshooting, workload tuning, and platform monitoring.
Automation and DevOps experience:
Terraform, Azure DevOps, GitHub Actions, Python, Bash, PowerShell. Understanding of identity/access management, audit logging, compliance, and data security. SQL proficiency; scripting for automation. Strong problem-solving, documentation, and stakeholder communication skills.
