Job Description
Cloud Data Engineer at Medasource Cloud Data Engineer at Medasource in Elmhurst, Illinois Posted in about 19 hours ago.
Type:
full-time Job Description:
Cloud Data Engineer Duration:
6-month Contract to Hire Location:
100% Remote, working CST Conversion salary: 110-125k Primary Purpose:
Responsible for the implementation of a technology framework providing technical support of initiatives in cloud computing, integration, and automation, with a focus on the design of systems and services that run on cloud platforms. The primary focus will be to support the design and development of end-to-end data integration solutions in cloud infrastructure using approved technologies. Contributes to the Cloud Data Engineering team effort to provide architecture and design support for data movement within the cloud infrastructure. Additionally, will aid in ensuring the integrity, reliability and quality of those data services implemented in the platform. Major Responsibilities:
Drive scope definition, requirements analysis, data and technical design, pipeline build, product configuration, unit testing, and production deployment. Design scalable ingestion processes to bring on-prem, API drive, 3rd party, end user generated data sources to integrate in common cloud infrastructure. Design reusable assets, components, standards, frameworks, and processes to accelerate and facilitate data integration projects. Develop data integration and transformation jobs using Python, SQL and ETL /ELT
tools. Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources. Build processes supporting data transformation, data structures, metadata, dependency and workload management. Design parameter driven orchestration to allow for change data capture and monitoring. Develop and implement scripts for data process maintenance, monitoring, and performance tuning. Test and document data processes through data validation and verification procedures. Collaborate with a cross-functional team to resolve data quality and operational issues. Ensure delivered solutions meet/perform to technical and functional/non-functional requirements. Ensure delivered solutions are realized in time frame committed. Provide technical guidance and mentorship to junior engineers, ensuring best practices in data engineering. Maintain overall industry knowledge on latest trends, technology, etc. Licensure, Registration and/or Certification Required:
Must have experience in data transformation and data pipeline development using GUI based tools or programming languages like SQL and Python. Education Required:
Bachelor's Degree in Computer Science or related field. Experience Required:
5 years of experience in at least two IT disciplines, including database management, cloud engineering, data engineering and middleware technologies. Includes 2 years of work experience with cloud platforms, including experience with data integration, performance optimization, and platform administration. Knowledge, Skills & Abilities Required:
Experience defining, designing, and developing solutions with data integration platforms/tools. Proven experience building and optimizing data pipelines, and data sets. Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases. Hands-on experience working with cloud based modern ELT tools and technologies like Fivetran, HVR, dbt, Airflow etc. Proficiency in Python and SQL for scripting and building data transformation processes is preferred. Experience in test automation with a focus on testing integrations, including APIs and data flows between enterprise systems. Must have experience with DevOps tool chains and processes. Must have hands-on experience with Snowflake Data Cloud
