Job Description The Senior Data Engineer designs, builds, tests, and supports the data pipelines and data productsbehind our analytics, reporting, and machine learning work on Azure and Microsoft Fabric.

The rolefocuses on data engineering:

ingesting, transforming, and modeling structured and unstructured datafrom sources such as Azure Synapse, Azure

SQL, SQL

Server, and ADLS Gen2. That data lands inFabric Lakehouse and Warehouse on OneLake through Azure Data Factory, Fabric Data Factorypipelines, Dataflow Gen2, and PySpark notebooks. The engineer will also design and run machinelearning (ML) pipelines with the Data Science team, automate builds and releases through Azure DevOpspipelines, and set up supporting Azure resources with Bicep templates. They will apply secure datapractices (Managed Identity, Microsoft Entra ID, Key Vault, OneLake security, and Microsoft Purview) andbuild data quality, lineage, and governance into every pipeline. This role works closely with DataScientists, Solution Architects, Software Engineers, DevOps Engineers, QA Engineers, Project Managers,Information Security Engineers, and Delivery Managers. Skills and Requirements

• Microsoft Fabric (Lakehouse, Warehouse, Data Factory, Notebooks, OneLake)
• Azure Data Factory and ETL/ELT design
• SQL/T-SQL, Python, PySpark
• ML pipeline concepts (feature engineering, training, batch scoring, MLflow)
• Azure DevOps CI/CD pipelines
• Bicep / Infrastructure as Code
• Data Lake / Lakehouse and medallion architecturNice to have skills:
• Azure Synapse Analytics and Azure Databricks
• Microsoft Purview
• Power BI semantic models and Direct Lake
• Fabric Real-Time Intelligence (Eventstream, KQL)
• GitHub Enterprise and fabric-cicd
• Experience migrating SAS workloads We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day.

We are an equal employment opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment without regard to race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or the recruiting process, please send a request to HR@insightglobal.com.