Software Engineer-Apache spark/Python/Big data Position Available In Mecklenburg, North Carolina
Tallo's Job Summary: Seeking a Software Engineer with expertise in Apache Spark, Python, and Big Data processing for a W2 contract opportunity in Charlotte, NC. Responsibilities include designing data pipelines, container development, and integrating Spark with various data sources. Requires 3+ years of Apache Spark experience and proficiency in Python/PySpark frameworks. Bachelor's degree in Computer Science or related field is preferred.
Job Description
STRATEGIC STAFFING SOLUTIONS
(S3)
HAS AN OPENING!
Strategic Staffing Solutions is currently looking for a Software Engineer for a W2 contract opportunity with one of our largest clients! Candidates should be willing to work on our
W-2 ONLY, NO C2C
Job Title:
Software Engineer -Big data
Role Type:
W2 only
Duration:
12 months
Locations:
Charlotte, NC Work Authorization:
USC/GC/H1B
visa transfers only. Seeking a Full stack engineer to join our team, with expertise in Cloud, Python/Spark. This role focuses on designing, deploying and managing scalable data processing solutions in a cloud-native environment. You will work closely with data scientists, software engineers, and DevOps team to ensure robust, high-performance data pipelines and analytics platforms.
Responsibilities :
Data Pipeline Development:
Design and implement large-scale data processing workflows using Apache Spark
Container Development:
Design and implement docker images
Optimization:
Tune Spark jobs for performance, leveraging OpenShift’s/Cloud resource management capabilities
Integration:
Integrate spark with other data sources (e.g., Kafka, s3, cloud storage) and sinks (e.g., databases, data lakes)
Experience:
o 3+ years working on Apache Spark for big data processing. o 1+ years of Django and Airflow development experience. o 1+ years of cloud development experience. (Google Cloud preferred)
Technical Skills:
- Proficiency in Spark frameworks(Python/PySpark)
- Familiarity with Docker and Kubernetes concerts(e.g., pods, deployments, services and images)
- Hands on working experience on distributed systems, cloud platforms(AWS, GCP, Azure), and data storage solutions (e.g., S3, HDFS)
Programming :
Strong coding skills in Python, Airflow, Django; experience with shell scripting is a plus.
- Educatio n: Bachelor’s degree in Computer Science, Engineering or related filed.
Job ID:
JOB-241574
Publish Date:
22 May 2025 Tagged as: Software Engineer-Apache spark/Python/Big data
