Find Jobs
Find Jobs Near You – Available Work in Your Location
Spark Data Engineer
Job Description
Spark Data Engineer at Swoon Spark Data Engineer at Swoon in Washington, Washington DC Posted in about 15 hours ago.
Type:
full-time
Hiring:
Spark/Scala Data Engineer Location:
McLean, VA -
Hybrid Work Model:
Hybrid - must be able to work onsite in
McLean, VA Duration:
12-month contract
Pay:
$70/hr W2 We're looking for an experienced Data Engineer to support a large-scale ETL modernization initiative. This role will focus on migrating legacy ETL workloads into a modern Spark/Scala-based architecture while ensuring data accuracy and consistency throughout the migration.
What You'll Be Doing:
- Build and maintain large-scale data pipelines using Apache Spark and Scala
- Modernize legacy ETL workloads into a newer data architecture
- Support legacy-to-modern ETL migrations
- Perform data comparison, reconciliation, and validation between legacy and modern pipelines
- Identify and troubleshoot data discrepancies during migration
- Ensure migrated pipelines maintain data quality and accuracy
Must-Haves:
- Strong Data Engineering background
- Hands-on Apache Spark experience
- Strong Scala experience
- Data pipeline development experience
- ETL modernization or migration experience
- Data comparison, validation, or reconciliation experience
- Experience working with legacy-to-modern architecture migrations
- Ability to work a hybrid schedule in McLean, VA The existing environment includes Ab Initio, but prior Ab Initio experience is NOT required.
This is a traditional Data Engineering position. AI/GenAI experience is not required. If you're a Senior Data Engineer with strong Spark/Scala experience and are open to a hybrid opportunity in McLean, VA, I'd love to connect.