Job Description Help for Job Description. Opens a new window. Job Description The Senior Data Engineer designs, builds, tests, and supports the data pipelines and data products behind our analytics, reporting, and machine learning work on Azure and Microsoft Fabric. The role focuses on data engineering: ingesting, transforming, and modeling structured and unstructured data from sources such as Azure Synapse, Azure

SQL, SQL

Server, and ADLS Gen2. That data lands in Fabric Lakehouse and Warehouse on OneLake through Azure Data Factory, Fabric Data Factory pipelines, Dataflow Gen2, and PySpark notebooks. The engineer will also design and run machine learning (ML) pipelines with the Data Science team, automate builds and releases through Azure DevOps pipelines, and set up supporting Azure resources with Bicep templates. They will apply secure data practices (Managed Identity, Microsoft Entra ID, Key Vault, OneLake security, and Microsoft Purview) and build data quality, lineage, and governance into every pipeline. This role works closely with Data Scientists, Solution Architects, Software Engineers, DevOps Engineers, QA Engineers, Project Managers, Information Security Engineers, and Delivery Managers. Skills and Requirements

• Microsoft Fabric (Lakehouse, Warehouse, Data Factory, Notebooks, OneLake)
• Azure Data Factory and ETL/ELT design
• SQL/T-SQL, Python, PySpark
• ML pipeline concepts (feature engineering, training, batch scoring, MLflow)
• Azure DevOps CI/CD pipelines
• Bicep / Infrastructure as Code
• Data Lake / Lakehouse and medallion architectur Nice to have skills:
• Azure Synapse Analytics and Azure Databricks
• Microsoft Purview
• Power BI semantic models and Direct Lake
• Fabric Real-Time Intelligence (Eventstream, KQL)
• GitHub Enterprise and fabric-cicd
• Experience migrating SAS workloads We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day.

We are an equal employment opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment without regard to race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or the recruiting process, please send a request to HR@insightglobal.com.