Data Platform Engineer- Openshift/Kubernetes

job summary: We are seeking a highly skilled Senior Data Engineer with 8+ years of hands-on experience in enterprise data engineering, including deep expertise in Apache Airflow DAG development, dbt Core modeling and implementation, and cloud-native container platforms (Kubernetes / OpenShift). This role is critical to building, operating, and optimizing scalable data pipelines that support financial and accounting platforms, including enterprise system migrations and high-volume data processing workloads. The ideal candidate will have extensive hands-on experience in workflow orchestration, data modeling, performance tuning, and distributed workload management in containerized environments.

location:

Jersey City, New Jersey job type: Contract salary: $70 - 75 per hour work hours: 9am to 5pm education: Bachelors responsibilities: Data Pipeline & Orchestration Design, develop, and maintain complex Airflow DAGs for batch and event-driven data pipelines Implement best practices for DAG performance, dependency management, retries, SLA monitoring, and alerting Optimize Airflow scheduler, executor, and worker configurations for high-concurrency workloads dbt Core & Data Modeling Lead dbt Core implementation, including project structure, environments, and CI/CD integration Design and maintain robust dbt models (staging, intermediate, marts) following analytics engineering best practices Implement dbt tests, documentation, macros, and incremental models to ensure data quality and performance Optimize dbt query performance for large-scale datasets and downstream reporting needs Cloud, Kubernetes & OpenShift Deploy and manage data workloads on Kubernetes / OpenShift platforms Design strategies for workload distribution, horizontal scaling, and resource optimization Configure CPU/memory requests and limits, autoscaling, and pod scheduling for data workloads Troubleshoot container-level performance issues and resource contention Performance & Reliability Monitor and tune end-to-end pipeline performance across Airflow, dbt, and data platforms Identify bottlenecks in query execution, orchestration, and infrastructure Implement observability solutions (logs, metrics, alerts) for proactive issue detection Ensure high availability, fault tolerance, and resiliency of data pipelines Collaboration & Governance Work closely with data architects, platform engineers, and business stakeholders Support financial reporting, accounting, and regulatory data use cases Enforce data engineering standards, security best practices, and governance policies qualifications: •

Equal Opportunity Employer:

Race, Color, Religion, Sex, Sexual Orientation, Gender Identity, National Origin, Age, Genetic Information, Disability, Protected Veteran Status, or any other legally protected group status.

At Randstad Digital, we welcome people of all abilities and want to ensure that our hiring and interview process meets the needs of all applicants. If you require a reasonable accommodation to make your application or interview experience a great one, please contact HRsupport@randstadusa.com. Pay offered to a successful candidate will be based on several factors including the candidate's education, work experience, work location, specific job duties, certifications, etc. In addition, Randstad Digital offers a comprehensive benefits package, including: medical, prescription, dental, vision, AD&D, and life insurance offerings, short-term disability, and a 401K plan (all benefits are based on eligibility). This posting is open for thirty (30) days. job detailssummary$70 - $75 per hourcontractbachelor degreecategorycomputer and mathematical occupationsreference1328599job details job summary: We are seeking a highly skilled Senior Data Engineer with 8+ years of hands-on experience in enterprise data engineering, including deep expertise in Apache Airflow DAG development, dbt Core modeling and implementation, and cloud-native container platforms (Kubernetes / OpenShift). This role is critical to building, operating, and optimizing scalable data pipelines that support financial and accounting platforms, including enterprise system migrations and high-volume data processing workloads. The ideal candidate will have extensive hands-on experience in workflow orchestration, data modeling, performance tuning, and distributed workload management in containerized environments.

location:

Jersey City, New Jersey job type: Contract salary: $70 - 75 per hour work hours: 9am to 5pm education: Bachelors responsibilities: Data Pipeline & Orchestration Design, develop, and maintain complex Airflow DAGs for batch and event-driven data pipelines Implement best practices for DAG performance, dependency management, retries, SLA monitoring, and alerting Optimize Airflow scheduler, executor, and worker configurations for high-concurrency workloads dbt Core & Data Modeling Lead dbt Core implementation, including project structure, environments, and CI/CD integration Design and maintain robust dbt models (staging, intermediate, marts) following analytics engineering best practices Implement dbt tests, documentation, macros, and incremental models to ensure data quality and performance Optimize dbt query performance for large-scale datasets and downstream reporting needs Cloud, Kubernetes & OpenShift Deploy and manage data workloads on Kubernetes / OpenShift platforms Design strategies for workload distribution, horizontal scaling, and resource optimization Configure CPU/memory requests and limits, autoscaling, and pod scheduling for data workloads Troubleshoot container-level performance issues and resource contention Performance & Reliability Monitor and tune end-to-end pipeline performance across Airflow, dbt, and data platforms Identify bottlenecks in query execution, orchestration, and infrastructure Implement observability solutions (logs, metrics, alerts) for proactive issue detection Ensure high availability, fault tolerance, and resiliency of data pipelines Collaboration & Governance Work closely with data architects, platform engineers, and business stakeholders Support financial reporting, accounting, and regulatory data use cases Enforce data engineering standards, security best practices, and governance policies qualifications: •

Equal Opportunity Employer:

Race, Color, Religion, Sex, Sexual Orientation, Gender Identity, National Origin, Age, Genetic Information, Disability, Protected Veteran Status, or any other legally protected group status.

At Randstad Digital, we welcome people of all abilities and want to ensure that our hiring and interview process meets the needs of all applicants. If you require a reasonable accommodation to make your application or interview experience a great one, please contact HRsupport@randstadusa.com. Pay offered to a successful candidate will be based on several factors including the candidate's education, work experience, work location, specific job duties, certifications, etc. In addition, Randstad Digital offers a comprehensive benefits package, including: medical, prescription, dental, vision, AD&D, and life insurance offerings, short-term disability, and a 401K plan (all benefits are based on eligibility). This posting is open for thirty (30) days.