Pay Growth
?
out of 5
Not enough data
Not enough info to score pay or growth
Find Jobs
Find Jobs Near You – Available Work in Your Location
Find & Apply For Software Developer / Engineer Jobs in Westfield, New Jersey
Browse jobs from a variety of sources below, sorted with the most recently published, nearest to the top. Click the title to view more information and apply online.
Skip to job details
Now viewing: Java Spark Engineer
DS
Delta System & Software, Inc.
Java Spark Engineer
Choose a Location
This role is available in multiple locations. Pick one to apply.
Review key factors to help you decide if the role fits your goals.
Job Security
?
out of 5
Not enough data
Calculating job security score...
Total Score
76
out of 100
Average of individual scores
Job Description
Java Spark Engineer at Delta System & Software, Inc. Java Spark Engineer at Delta System & Software, Inc. in Westfield, New Jersey Posted in 1 day ago.
Type:
full-time
Responsibilities :
- Architect and build scalable, fault-tolerant data pipelines using Apache Spark (Java)
- Lead design of batch and streaming ETL/ELT systems handling large data volumes
- Deep-dive performance tuning: partitioning strategy, memory management, shuffle/skew optimization, job cost reduction
- Set coding standards and lead code/design reviews across the team
- Drive technical decisions on data architecture, storage formats, and pipeline orchestration
- Mentor mid-level and junior engineers; act as a technical escalation point
- Partner with product, analytics, and platform teams to translate requirements into scalable systems
- Own production reliability - on-call ownership, incident response, root-cause analysis for pipeline failures
- Evaluate and introduce new tools/frameworks where they improve the system
- Contribute to capacity planning and cost optimization for cluster infrastructure Required Qualifications
- Bachelor's or Master's degree in Computer Science, Engineering, or related field
- 7+ years of professional Java development experience
- 5+ years hands-on experience with Apache Spark in production environments
- Expert-level understanding of distributed systems: fault tolerance, data locality, shuffle mechanics, resource management
- Proven track record designing systems processing terabyte+ scale data
- Strong SQL skills and deep familiarity with columnar storage formats (Parquet, ORC, Avro, Delta Lake/Iceberg)
- Experience with cluster managers (YARN, Kubernetes) and cloud-managed Spark
- Proficiency with Kafka
- Strong grasp of CI/CD, containerization, and infrastructure-as-code practices Preferred Qualifications
- Experience with Flink or other stream-processing frameworks
- Familiarity with data governance, lineage, and quality frameworks
- Experience with workflow orchestration at scale
- Background in system design for multi-tenant or multi-region data platforms
- Prior experience leading a team or acting as a technical lead Soft Skills / Leadership
- Excellent communication - able to explain technical tradeoffs to non-technical stakeholders
- Strong mentorship and coaching ability
- Comfortable driving ambiguous, cross-team technical initiatives