Data Engineer
Compunnel, Inc.
Lisle, IL (In Person)
Full-Time
Skill Insights
Compare your current skills to what this opportunity needs—we'll show you what you already have and what could strengthen your application.
Job Description
Job Summary The Data Engineer will work collaboratively with business, IT, Analytics, and Data Science teams to design, develop, and maintain high-performance data pipelines and data platform components. The role focuses on building scalable data solutions, ensuring data quality, and supporting continuous integration and delivery processes. This position also involves troubleshooting data issues, documenting solutions, and supporting internal teams through data access and delivery. Key Responsibilities Collaborate with business, IT, Analyst, and Data Science teams to gather and understand business requirements. Design, develop, deploy, and support high-performance inbound and outbound data pipelines. Model data platforms by applying business logic and building objects in the semantic layer. Optimize data pipelines for performance, scalability, and reliability. Implement CI/CD pipelines for continuous deployment and delivery of data products. Ensure quality of critical data elements and develop remediation plans in partnership with business and system owners. Document data pipeline designs and support strategies. Capture, store, and share data lineage and operational metadata. Troubleshoot and resolve data engineering issues. Develop REST APIs to provide data access to internal teams. Mentor and guide junior data engineers. Perform other duties as assigned. Comply with all company policies and standards. Required Qualifications Bachelor's degree in Computer Science, Computer Engineering, Software Engineering, or a related technical field. Minimum 6 years of experience in data engineering, including data platforms, ingestion, data management, or publication/analytics. At least 2 years of experience with Google Cloud Platform services such as BigQuery, Composer, GCS, DataStream, and Dataflow. Expertise in SQL and Python programming. Experience using Airflow or similar workflow management tools for data extraction and ingestion. Strong skills in query tuning for performance and scalability. Experience with real-time data ingestion using tools such as GCP Pub/Sub, Kafka, Spark, or similar technologies. Strong organizational, prioritization, and analytical abilities. Proven experience delivering solutions through iterative and incremental execution. Excellent problem-solving and critical-thinking skills, with the ability to understand complex data challenges. Experience working in an agile environment. Preferred Qualifications Master's degree in Computer Science, Computer Engineering, Software Engineering, or a related technical field.
Similar remote jobs
Volkswagen Group DE
Ashburn, VA
Posted2 days ago
Updated1 day ago
Similar jobs in Lisle, IL
Similar jobs in Illinois
U025 Kraft Foods Group Brands LLC Company
Chicago, IL
Posted2 days ago
Updated1 day ago
Papa Johns
Champaign, IL
Posted2 days ago
Updated1 day ago