Compare your current skills to what this opportunity needs—we'll show you what you already have and what could strengthen your application.
Job Description
Principal Data Engineer
WTW - 3.6
New York, NY Job Details Full-time 10 hours ago Benefits Health insurance Dental insurance Life insurance Qualifications AI models Data model design Databricks Data transformation pipeline development Data lake Data modeling projects Tooling Systems architecture within technology Spark GitHub Actions Research AI platforms (beyond public GPTs) Machine learning projects Schema design Data governance Infrastructure architecture design SQL Data Architecture Design (Architecture design skills) Production systems Machine intelligence Application design Azure Data Factory Terraform Azure AD REST Software documentation Technical research projects GraphQL APIs Kafka GraphQL Full Job Description Description WTW's data products organization exists to turn data into a source of competitive advantage — powering smarter decisions, differentiating our client offer, and transforming how the business operates. As a Principal Data Engineer, you will be a senior technical voice in that effort, shaping the architecture and engineering practices that make it possible. This is not a role for someone who wants to execute a defined plan. You will be working across two fronts simultaneously: building the core platform capabilities — the virtualized data lake, Common Data Layer, and data contract framework — that give WTW a unified, AI-ready data foundation; and embedding directly within product domains to deliver the high-quality, reusable data products that drive real business value. You will set the technical bar, define the patterns others follow, and bring genuine engineering craft to a transformation that is still being designed. This role sits at the intersection of platform engineering and domain product delivery — a rare combination that requires both the depth to make hard architectural calls and the pragmatism to ship things that work today while building for tomorrow. Qualifications What you'll bring Experience Solid experience in data engineering, with demonstrable depth across platform architecture, data modeling, and production-grade pipeline delivery. Proven experience building or significantly contributing to a modern data platform at scale — lakehouse, data mesh, or equivalent — serving a large and complex organization. Track record of setting technical direction and influencing engineering practice beyond your immediate team; you have been the person others look to for the hard calls. Experience delivering data products that serve diverse consumers — analytics, APIs, AI/ML systems — with different latency, quality, and access requirements. Background in financial services, insurance, or broking is a plus but not required. Technical Skills Deep expertise in Databricks, including Unity Catalog, Delta Lake, Delta Sharing, and the full Databricks data engineering and ML stack. Strong command of DBT for modular, testable, and well-documented data transformation; a clear point of view on semantic modeling and metric layer design. Fluency in Python and SQL; comfort with Spark for large-scale data processing and transformation. Experience with modern data ingestion patterns across structured, unstructured, CDC, API, and streaming sources (ADF, Kafka, Event Hubs, or equivalent). Working knowledge of data contract standards and tooling (e.g., ODCS), and practical experience implementing quality, schema, and SLA commitments in production. Familiarity with the machine interface layer: APIs (REST, GraphQL), AI agent frameworks, MCP, vectorization, and low-latency query patterns for AI consumption.
Understanding of foundational governance capabilities:
access security (Entra ID, Unity Catalog), data lineage tooling, CI/CD for data (Github Actions, Terraform, DBT Cloud), and observability practices. AI Fluency AI fluency is a core requirement of this role — in two distinct dimensions. First, you will design and build data infrastructure that powers AI-driven products and agent workflows; you need to understand what AI systems require from data and how to deliver it reliably. Second, you are expected to use AI actively in your own engineering practice — for code generation, documentation, debugging, pipeline design, and technical research — treating it as a force multiplier, not a curiosity. Practical experience integrating LLMs or AI agents with data platforms — whether through RAG pipelines, semantic layers, vector stores, or agentic data access patterns — is a strong advantage. How You Work You think in systems — you see how individual components connect, where coupling creates risk, and how today's decisions constrain tomorrow's options. You hold a high bar for engineering quality — correctness, testability, observability, and documentation are non-negotiable, not nice-to-haves. You are pragmatic under pressure; you know when to build the right thing and when to build the thing that ships, and you are honest about the difference. You communicate technical complexity with clarity — to engineers, product managers, and senior stakeholders — without losing precision or oversimplifying trade-offs. You reach for AI instinctively as part of how you work, and you actively share what you learn with the team around you. You are energized by greenfield scope; you do your best work when you are writing the playbook, not following one. What we offer Enjoy a benefits package designed to help you thrive, both professionally and personally. You'll receive 25 days of annual leave plus an extra WTW day to relax and recharge. Our comprehensive health and wellbeing offering includes private healthcare, life insurance, group income protection, and regular health assessments, all giving you peace of mind. Secure your future with our defined contribution pension scheme, featuring matched contributions up to 10% from the company. We support your growth and balance with hybrid working options, access to an employee assistance programme, and a fully paid volunteer day to make a difference in your community. On top of these, you can opt into a variety of additional perks including an electric vehicle car scheme, share scheme, cycle-to-work programme, dental and optical cover, critical illness protection, and much more. Start making the most of your career and wellbeing with a range of benefits tailored for you. Equal Opportunity Employer We're committed to equal employment opportunity and provide application, interview and workplace adjustments and accommodations to all applicants. If you foresee any barriers, from the application process through to joining WTW, please email
