Job Description
Job Title:
Senior Data Integration Engineer/Designer/Architect Location:
Peoria, IL (Hybrid) Duration:
12 Months SnapLogic AWS Python Snowflake DataStage 1.Design Responsibilities Solution & Technical Design Translate business requirements into scalable, maintainable, and secure technical designs across DataStage, SnapLogic, AWS, Python, and Snowflake ecosystems. Create high-level and low-level design documents covering data flows, mappings, process orchestration, and integration patterns. Develop data models, transformation logic, and interface specifications for batch, real-time, and event-driven pipelines. Ensure designs align with enterprise architecture standards, security guidelines, and best practices. Collaborate with product owners, analysts, and architects to finalize solution design and validate technical feasibility. 2.Senior Development Responsibilities Hands-on Development & Implementation Build and enhance ETL/ELT pipelines in IBM DataStage, SnapLogic, and Python. Develop scalable Snowflake SQL, stored procedures, and performance-optimized ELT logic. Implement AWS services (Lambda, S3, SNS, SQS, IAM, CloudWatch,Cloudformation, EventBridge) as part of cloud-native data pipelines. Code reusable frameworks, utilities, and components to accelerate team productivity. Conduct peer code reviews, mentor team members, and establish coding standards. Quality & Delivery Perform unit testing and support integration/UAT activities. Optimize workflows for performance, cost-efficiency, and maintainability. Ensure version control, CI/CD integration, and documentation are consistently maintained. GitHub CI/CD integration 3.Production Support & Issue Resolution Responsibilities Incident & Problem Management Serve as the point for any production issues across DataStage, SnapLogic, Snowflake, AWS, and Tidal. Responsible for analyzing and fixing production issues in any system. Analyze root causes, identify systemic issues, and propose permanent fixes. Develop automated monitoring, alerting, using Python/AWS. Stability & Reliability Work closely with operations teams to ensure SLAs, uptime, and performance thresholds are met. Improve recovery processes, failover mechanisms, and operational resiliency. Troubleshoot orchestration and scheduling issues in Tidal Enterprise Scheduler. 4.Architecture Input & Technical Leadership Responsibilities Architecture Contributions Provide architectural guidance for new integrations, data warehouse initiatives, and migration projects. Recommend best practices for cloud adoption, pipeline modernization, and platform evolution. Contribute to reference architectures, standards, reusable patterns, and decision frameworks. Strategic Technology Guidance Evaluate emerging tools and technologies in data engineering, integration, cloud, and orchestration. Champion automation, observability, data quality, and performance optimization initiatives. Collaborate with enterprise architects and infrastructure teams to ensure future-proof design choices. 5.Cross-functional Collaboration Responsibilities Work with QA, business analysts, and project managers to enable smooth delivery. Assist and collaborate with offshore teams to ensure alignment, effective knowledge transfer, and smooth delivery across time zones. Communicate technical concepts clearly to both technical and non-technical stakeholders. Tools & Technology Scope ETL/ELT:
IBM DataStage, SnapLogic Cloud:
AWS (Compute, Storage, Serverless, Orchestration, IAM, Monitoring) Data Warehouse:
Snowflake Programming:
Python, SQL Scheduling:
Tidal Enterprise Scheduler Other:
Git, CI/CD tools, DevOps pipelines, monitoring platforms Mail:
Dileep (at) humacinc (dot) com
