Data Engineer

We are looking for a skilled Data Engineer to join our team in Carmel, Indiana. In this long-term contract role, you will design, build, and optimize data pipelines and systems to support business needs. The ideal candidate will bring expertise in data engineering tools and frameworks, along with a passion for solving complex challenges.

Responsibilities:

• Develop and maintain robust data pipelines using modern frameworks and tools.
• Implement ETL processes to ensure accurate and efficient data transformation.
• Optimize data storage and retrieval systems for performance and scalability.
• Collaborate with cross-functional teams to understand data requirements and deliver solutions.
• Utilize Apache Spark and Hadoop for large-scale data processing.
• Work with Databricks to streamline data workflows and enhance analytics.
• Apply machine learning techniques using tools like scikit-learn and Pandas.
• Integrate Kafka for real-time data streaming and processing.
• Analyze and troubleshoot data-related issues to ensure system reliability.
• Document processes and workflows to support future development and maintenance.