DataBricks Lead

At Staffworxs, we don t just connect talent we power transformation. Headquartered in Frisco, TX, with teams in Bengaluru and Hyderabad, we combine global reach with deep expertise. Our Digital & Data Analytics practice drives growth and innovation for some of the world s top brands, who continue to retain us as their trusted partner. If you re ready to make an impact, you re in the right place.

Job Details:

Job Title:

DataBricks Lead Location:

Dearborn, MI (Onsite/Hybrid)

Experience:

12+ Years Job Summary We are seeking a highly experienced DataBricks Lead with deep expertise in Azure and Databricks to design and implement scalable, high-performance lakehouse solutions within a manufacturing environment. The ideal candidate will drive end-to-end data architecture, ensuring robust data ingestion, governance, quality, and performance. Mandatory Skills Strong expertise in Databricks and Apache Spark (PySpark/Scala) Hands-on experience with Delta Lake and Medallion Architecture (Bronze/Silver/Gold) Extensive experience with Microsoft Azure services (ADLS, ADF, Synapse, Event Hubs) Proven experience in Data Ingestion frameworks (batch and streaming) Strong implementation experience in Data Quality (DQ) frameworks Deep understanding of metadata management and metadata table structures Experience in Teradata migration to Databricks/Azure platforms Solid expertise in validation and testing approaches for data pipelines Knowledge of Unity Catalog and data governance best practices Strong SQL skills and data modeling experience (star/snowflake schemas) Experience with CI/CD pipelines (Azure DevOps, GitHub Actions) Key Responsibilities Design and implement scalable, secure, and high-performance data architectures on Azure Databricks Develop and optimize data pipelines, ingestion frameworks, and lakehouse solutions Implement robust data quality, validation, and testing frameworks Lead Teradata to Databricks migration initiatives, ensuring data integrity and performance Define and manage metadata structures and governance frameworks Ensure data governance, security, and compliance using Unity Catalog and Azure tools Collaborate with cross-functional teams, business stakeholders, and engineering teams Drive performance tuning and cost optimization across the data platform Preferred Qualifications Experience in Manufacturing or Automotive domain Relevant Azure and Databricks certifications Strong leadership and stakeholder management skills Staffworxs is an Equal Opportunity Employer. We celebrate diversity and are committed to creating an inclusive workplace for all employees, regardless of race, color, religion, gender, sexual orientation, national origin, age, disability, or veteran status.