Azure Databricks Admin

We are seeking an Azure Databricks Admin experienced in Cloud Platform Databricks SME, responsible for overseeing the Platform administration, Security, new NPI tools integration, migrations, platform maintenance and other platform administration activities on Azure/AWS. The ideal candidate will have hands-on experience with Azure/AWS services Infrastructure as Code (IaC), platform provisioning & administration, cloud network design, cloud security principles and automation. Databricks admin will plays a pivotal role in admin, security best practices, platform sustain support, new tools adoption, cost optimization, supporting new patterns/design solutions using the Databricks platform. This role ensures platform stability, operational efficiency, security governance, and alignment with enterprise data management strategies. The SME will work closely with Data Governance, Data Engineering, Infrastructure, and Security teams to design scalable solutions, support business users, drive metadata adoption, and maintain high availability of platforms. One will be part of a learning culture, where teamwork and collaboration are encouraged, excellence is rewarded, and diversity is respected and valued.

Required Qualifications:

Bachelor s degree or foreign equivalent required from accredited institution. Will also consider three years of progressive experience in the specialty in lieu of every year of education Candidate must be located within commuting distance of Plano/TX, Hartford, Indianapolis, Raleigh or be willing to relocate to the area. Experience in IT cloud infrastructure, architecture and operations, including security, and Platform administration.

Preferred Qualifications:

Experience of architecture and optimize big data pipelines using Apache Spark, Delta Lake, and Databricks-native tools. Able to design scalable data ingestion and transformation workflows, including batch and streaming (e.g., Kafka, Spark Structured Streaming). Experience of creating integration guidelines to configure and integrate Databricks with other existing security tools relevant to data access control. Can implement data security and governance using Unity Catalog, access controls, and data classification techniques. Experience of supporting migration of legacy systems to Databricks on cloud platforms like Azure, AWS, or Google Cloud Platform. Can manage cloud platform operations with a focus on FinOps support, optimizing resource utilization, cost visibility, and governance across multi-cloud environments. Expertise in Databricks platform, security features, Unity Catalog, and data access control mechanisms. Experience with data classification and masking techniques. Strong understanding of cloud cost management, with hands-on experience in usage analytics, budgeting, and cost optimization strategies across multi-cloud platforms. Strong knowledge of cloud architecture, design, and deployment principles and practices, including microservices, serverless, containers, and DevOps. Deep expertise in Azure/AWS big data & analytics technologies, including Databricks, real time data ingestion, data warehouses, serverless ETL, No SQL databases, DevOps, Kubernetes, virtual machines, web/function apps, monitoring and security tools. Deep expertise in Azure/AWS networking and security fundamentals, including network endpoints & network security groups, firewalls, external/internal DNS, load balancers, virtual networks and subnets. Proficient in scripting and automation tools, such as PowerShell, Python, Terraform, and Ansible. Certifications in Azure/AWS/Databricks platform administration, networking and security are preferred. Machine Learning & AI integration using MLflow, AutoML, or custom models.