Sr. Data Engineer

SENIOR DATA ENGINEER ROLE AND RESPONSIBILITIES

The Senior Data Engineer will play a lead role in acquiring, transforming, and integrating data from enterprise systems into scalable data platforms. The role involves designing high-performance data solutions, mentoring junior engineers, and collaborating across different functions to ensure strategic data initiatives are delivered efficiently and effectively. This individual will have a strong track record in architecting and building robust Data Warehouses using Microsoft SQL Server and Azure technologies. Strong expertise in healthcare data domains is highly preferred.

PRIMARY DUTIES

Lead the integration of data from Clinical/Healthcare Practice Management Systems, Electronic Medical Record Systems (EMRs), HR systems, Accounting, Customer Relationship Management systems (CRM), and other enterprise systems. Architect and oversee the development of scalable data platforms and database architectures supporting multiple business lines. Design and optimize complex ETL/ELT data pipelines using Azure Data Factory, other Azure services and python, ensuring high reliability and performance. Orchestrate pipelines that leverage AI/LLMs for data extraction from various documents and sources. Drive initiatives to capture all necessary data and orchestrate the development of sustainable enterprise-grade databases. Conduct advanced data profiling, cleansing, and transformation for analytics and reporting teams. Drive implementation of Master Data Management (MDM) strategies to ensure data consistency and integrity. Identify process improvement opportunities and spearhead automation to reduce delivery time and increase quality. Establish and maintain comprehensive data lineage, monitoring, and operational tracking systems. Provide hands-on support while mentoring junior engineers and contributing to a culture of knowledge sharing and continuous improvement. Collaborate closely with stakeholders to gather evolving data requirements and translate them into scalable technical solutions. Maintain high standards for code quality through documentation, source control, code reviews, and rigorous testing practices. Identify integration gaps, recommend solutions, and ensure continuous improvement of data processes. Establish and enforce best practices for data engineering and integration across the team. Explore and evaluate emerging Azure features, leading proofs of concept to assess fit for purpose.

QUALIFICATIONS AND REQUIREMENTS

7+ years of experience in database and ETL development roles. 4+ years of deep hands-on experience with Azure Data Factory (ADF). 3+ years of experience with healthcare and/or financial data or other highly regulated vertical segments. 2+ years of experience using python. Strong working knowledge of Azure ecosystem tools. Advanced proficiency in T-SQL and SQL Server. Strong grasp of data modeling, indexing, and schema design principles. Proven ability to manage multiple priorities and drive solutions from conception to production. Effective collaborator and communicator, capable of interfacing with all stakeholders. Bachelor''s degree or higher.

PREFERRED EXPERIENCE

Experience working with data integration related to Healthcare EDI files, such as 835, 837, etc. Experience working on data extraction from documents using AI/LLMs.