Data Engineer
Job
Robert Half
Madison, WI (In Person)
Full-Time
Review key factors to help you decide if the role fits your goals.
Pay Growth
?
out of 5
Not enough data
Not enough info to score pay or growth
Job Security
?
out of 5
Not enough data
Calculating job security score...
Total Score
81
out of 100
Average of individual scores
Skill Insights
Compare your current skills to what this opportunity needs—we'll show you what you already have and what could strengthen your application.
Job Description
Description We are looking for an experienced Data Engineer to join our team on a contract basis in Madison, Wisconsin. In this role, you will focus on designing, building, and optimizing robust data pipelines and cloud-based data architectures. This position requires a strong technical background and the ability to work with various data sources, tools, and platforms to drive seamless data integration and transformation.
Responsibilities:
- Design and develop scalable data pipelines to support business needs and analytics.
- Utilize Snowflake and cloud-based platforms, such as Azure, to manage and optimize data architecture.
- Integrate and customize data ingestion processes for platforms like Shopify, Oracle, and NetSuite.
- Collaborate with teams to connect data sources and deliver data-driven solutions for dashboards and AI applications.
- Implement and manage ETL processes to ensure data accuracy and reliability.
- Work with tools like Apache Spark, Hadoop, and Kafka to process and analyze large datasets.
- Develop APIs and custom applications to facilitate seamless data movement and integration.
- Leverage AWS services, including AWS Data Pipeline and CloudFormation, to enhance data workflows.
- Troubleshoot and resolve data pipeline issues to maintain system efficiency and performance. Requirements
- A minimum of 7 years of experience in data engineering or a related field.
- Proficiency in Snowflake and cloud computing platforms, such as Azure or AWS.
- Strong expertise in ETL processes and tools for data transformation and integration.
- Hands-on experience with Apache Spark, Hadoop, and Kafka.
- Advanced programming skills in Python and SQL for data manipulation and analysis.
- Familiarity with APIs and custom application development for data ingestion.
- Demonstrated ability to work with diverse data sources, including Shopify, Oracle, and NetSuite.
- Knowledge of AWS services like AWS Data Pipeline and CloudFormation.
Similar remote jobs
Wells Fargo
Chandler, AZ
Posted2 days ago
Updated3 hours ago
Similar jobs in Madison, WI
The Hertz Corporation
Madison, WI
Posted2 days ago
Updated3 hours ago
Continental Properties
Madison, WI
Posted2 days ago
Updated3 hours ago
Madison Metropolitan School District
Madison, WI
Posted2 days ago
Updated3 hours ago
Similar jobs in Wisconsin
APSI Construction Management
Milwaukee, WI
Posted2 days ago
Updated3 hours ago
The Hertz Corporation
Madison, WI
Posted2 days ago
Updated3 hours ago