We are looking for a Data Engineer to join a growing team supporting data-driven initiatives within the energy and natural resources sector in Houston, Texas. This contract position with the potential to become permanent is ideal for someone who enjoys building reliable data pipelines, improving data accessibility, and working with modern big data technologies. The role offers the opportunity to contribute to scalable data solutions that support operational and business insights.
Responsibilities:
- Design, build, and maintain scalable data pipelines to collect, transform, and deliver data from multiple sources
- Develop and optimize ETL workflows to support analytics, reporting, and downstream applications
- Use Python and Apache Spark to process large-volume datasets efficiently and reliably
- Work with Hadoop-based environments to manage distributed data storage and processing needs
- Implement and support Kafka-based data streaming solutions for real-time data movement
- Partner with technical and business stakeholders to understand data requirements and translate them into practical engineering solutions
- Monitor pipeline performance, troubleshoot data issues, and improve overall data quality and reliability