Data Engineer

We are looking for an experienced Data Engineer to join our team on a contract basis in Madison, Wisconsin. In this role, you will focus on designing, building, and optimizing robust data pipelines and cloud-based data architectures. This position requires a strong technical background and the ability to work with various data sources, tools, and platforms to drive seamless data integration and transformation.

Responsibilities:

• Design and develop scalable data pipelines to support business needs and analytics.
• Utilize Snowflake and cloud-based platforms, such as Azure, to manage and optimize data architecture.
• Integrate and customize data ingestion processes for platforms like Shopify, Oracle, and NetSuite.
• Collaborate with teams to connect data sources and deliver data-driven solutions for dashboards and AI applications.
• Implement and manage ETL processes to ensure data accuracy and reliability.
• Work with tools like Apache Spark, Hadoop, and Kafka to process and analyze large datasets.
• Develop APIs and custom applications to facilitate seamless data movement and integration.
• Leverage AWS services, including AWS Data Pipeline and CloudFormation, to enhance data workflows.
• Troubleshoot and resolve data pipeline issues to maintain system efficiency and performance.