Pay Growth
?
out of 5
Not enough data
Not enough info to score pay or growth
Data Engineer
Job
Robert Half
Washington, DC (In Person)
Full-Time
Review key factors to help you decide if the role fits your goals.
Job Security
?
out of 5
Not enough data
Calculating job security score...
Total Score
81
out of 100
Average of individual scores
Skill Insights
Compare your current skills to what this opportunity needs—we'll show you what you already have and what could strengthen your application.
Job Description
Data Engineer - Databricks / Azure / AI AnalyticsYou must be able to obtain and maintain a public trust clearance,Position OverviewWe are seeking a highly capable Data Engineer to design and support scalable data pipelines and analytics environments within a cloud-based Azure data platform. This role focuses on building modern data solutions using Databricks, Spark, and distributed data architectures, supporting enterprise-level analytics and AI initiatives.
The ideal candidate brings hands-on expertise in Databricks engineering, cloud data pipelines, and data integration, along with strong collaboration skills to translate business requirements into technical solutions. This position offers the opportunity to work on large-scale data platforms and support advanced analytics and AI-driven workloads.
Key ResponsibilitiesData Engineering & Pipeline DevelopmentDesign, build, and optimize data pipelines using Databricks and SparkImplement Medallion architecture and scalable data processing workflowsDevelop ingestion pipelines for structured, streaming, and unstructured datasetsCloud & Platform IntegrationWork with Azure services (Data Factory, Storage, Functions, Log Analytics)Integrate data across multiple sources to enable high-quality analyticsSupport hybrid cloud initiatives and evolving data platformsData Management & OptimizationEnsure data quality, integrity, and accessibility across systemsMonitor pipeline performance and optimize cost, scalability, and efficiencySupport data governance, cataloging, and compliance standardsPlatform Operations & SupportTroubleshoot performance issues, cluster stability, and configuration managementSupport end-user requests and provide front-line platform supportImplement monitoring, logging, and alerting solutionsDevOps & AutomationDevelop and maintain CI/CD pipelines and infrastructure-as-code (IaC)Automate deployment and data workflows for improved efficiencySupport continuous delivery within Agile environments
The ideal candidate brings hands-on expertise in Databricks engineering, cloud data pipelines, and data integration, along with strong collaboration skills to translate business requirements into technical solutions. This position offers the opportunity to work on large-scale data platforms and support advanced analytics and AI-driven workloads.
Key ResponsibilitiesData Engineering & Pipeline DevelopmentDesign, build, and optimize data pipelines using Databricks and SparkImplement Medallion architecture and scalable data processing workflowsDevelop ingestion pipelines for structured, streaming, and unstructured datasetsCloud & Platform IntegrationWork with Azure services (Data Factory, Storage, Functions, Log Analytics)Integrate data across multiple sources to enable high-quality analyticsSupport hybrid cloud initiatives and evolving data platformsData Management & OptimizationEnsure data quality, integrity, and accessibility across systemsMonitor pipeline performance and optimize cost, scalability, and efficiencySupport data governance, cataloging, and compliance standardsPlatform Operations & SupportTroubleshoot performance issues, cluster stability, and configuration managementSupport end-user requests and provide front-line platform supportImplement monitoring, logging, and alerting solutionsDevOps & AutomationDevelop and maintain CI/CD pipelines and infrastructure-as-code (IaC)Automate deployment and data workflows for improved efficiencySupport continuous delivery within Agile environments