firstPRO is seeking a highly skilled Senior Data Engineer for a consulting assignment supporting an enterprise cloud-based data platform. The Senior Data Engineer will be responsible for maintaining, optimizing, and expanding enterprise data pipelines within an Azure and Databricks environment. This is a hands-on individual contributor role focused heavily on production support, pipeline optimization, and new data development. The ideal candidate will work closely with data architects, engineers, reporting teams, and offshore resources. Key Responsibilities Maintain, troubleshoot, and enhance enterprise data pipelines. Design and develop scalable data pipelines using Python, PySpark, Spark, and Databricks. Build data workflows across raw, transformed, and curated data layers. Integrate new data sources and fields to support analytics and reporting. Monitor pipeline performance, reliability, and resource utilization. Identify and resolve performance, scalability, data quality, and processing issues. Optimize workloads to improve efficiency and reduce cloud costs. Troubleshoot transformation, dependency, orchestration, and production issues. Support smaller data engineering projects and technical enhancements. Partner with data architects to ensure solutions follow established standards and architecture. Collaborate with reporting and analytics teams to deliver reliable data for dashboards, semantic models, and analytics. Work effectively with both U.S.-based and offshore technical teams. Maintain clear documentation for pipelines, code, dependencies, processes, and technical decisions. Provide production support during standard business hours; no formal on-call rotation is expected. Required Qualifications Several years of professional experience as a Data Engineer, Senior Data Engineer, or similar hands-on role. Strong production experience with PySpark and/or Apache Spark. Hands-on experience developing data solutions using Databricks. Advanced Python development skills. Proven experience building, maintaining, and troubleshooting enterprise data pipelines. Strong understanding of distributed data processing and cluster-based computing. Experience working with data lake or lakehouse architectures and raw, transformed, and curated data layers. Ability to optimize pipelines for performance, scalability, reliability, and cost efficiency. Experience supporting production data platforms and working within existing codebases. Strong technical documentation and communication skills. Ability to work independently while collaborating with architects, engineers, analytics teams, and technical stakeholders. Preferred Qualifications Experience with Microsoft Azure data environments. Experience with Azure Data Factory or similar orchestration tools. Familiarity with Microsoft Fabric and semantic data models. Experience supporting enterprise-scale lakehouse environments. Knowledge of data governance and data quality practices. Experience coordinating development or support activities with offshore teams.

Pay:

$65.00 - $70.00 per hour

Benefits:

Dental insurance Health insurance Vision insurance

Work Location:

In person