Data Engineer Position Available In Hillsborough, Florida
Tallo's Job Summary: Join our team as a Data Engineer - Scala/Spark to develop, test, and deploy data processing applications. Optimize Spark applications, work with Cloudera Hadoop ecosystem, and collaborate with various teams. Troubleshoot performance issues, ensure data integrity, and implement CI/CD pipelines. Competitive salary and opportunity for growth.
Job Description
Data Engineer
We’re looking for a Data Engineer – Scala/Spark with deep expertise in big data processing and distributed systems to join our growing team! If you’re passionate about building scalable data solutions and thrive in fast-paced environments, this could be the perfect opportunity.
Key Responsibilities:
Develop, test, and deploy data processing applications using Apache Spark and Scala. Optimize and tune Spark applications for better performance on large-scale data sets. Work with the Cloudera Hadoop ecosystem (e.g., HDFS, Hive, Impala, HBase, Kafka) to build data pipelines and storage solutions. Collaborate with data scientists, business analysts, and other developers to understand data requirements and deliver solutions. Design and implement high-performance data processing and analytics solutions. Ensure data integrity, accuracy, and security across all processing tasks. Troubleshoot and resolve performance issues in Spark, Cloudera, and related technologies. Implement version control and CI/CD pipelines for Spark applications.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
Report this job
Dice Id:
10462843
Position Id:
8616634