Find Jobs
Find Jobs Near You – Available Work in Your Location
Azure Databricks Platform Architect / Solution Architect - No C2C
Job Description
Architecture & Strategy Define end-to-end migration strategy from Azure Databricks to AWS Databricks. Design scalable Lakehouse architecture using Medallion principles (Bronze, Silver, Gold). Develop Day 1 Business Continuity and Day 2 Modernization / AI Enablement migration roadmaps. Perform application and dependency assessments across upstream and downstream systems. Establish architecture patterns, standards, and best practices for cloud-native data platforms. Migration & Modernization Lead migration of data pipelines, notebooks, Delta tables, workflows, and data products. Modernize legacy ETL/ELT frameworks using Databricks native capabilities. Optimize performance, scalability, security, and operational efficiency. Define migration approaches for CDC, batch, streaming, and real-time workloads. Drive technology rationalization and tool consolidation initiatives. AI-Ready Data Platform Build AI-ready data foundations leveraging Delta Lake and Unity Catalog. Design data architectures supporting ML, GenAI, RAG, feature stores, and advanced analytics. Enable governed data access for data scientists and AI applications. Define semantic models, metadata strategies, lineage, and data discovery frameworks. Establish frameworks for AI governance and responsible AI adoption. Data Governance & Security Architect enterprise-wide governance using Unity Catalog. Design data lineage, auditing, access controls, masking, and compliance standards. Requirements 15+ Years of experience Azure Databricks AWS Databricks Lakehouse architecture Medallion principles (Bronze, Silver, Gold) Delta Lake Unity Catalog ML GenAI RAG feature stores advanced analytics Data Governance Data lineage auditing access controls masking compliance standards ETL/ELT frameworks