Pay Growth
?
out of 5
Not enough data
Not enough info to score pay or growth
Find Jobs
Find Jobs Near You – Available Work in Your Location
Skip to job details
TC
The Copley Consulting Group
Data Engineer III
Review key factors to help you decide if the role fits your goals.
Job Security
?
out of 5
Not enough data
Calculating job security score...
Total Score
78
out of 100
Average of individual scores
Job Description
Our client is currently seeking a Data Engineer
Build scalable and reliable data pipelines to support data ingestions (batch and /or streaming) and transformation from multiple data sources such as Flat Files, SQL, AWS RDS, S3 etc. and help centralize the information on Snowflake.
Hands on experience in ingestion, transformation, and database technologies.
Expertise in SQL, complex query writing, query organization, optimization.
Create unit/integration tests and implement automated build and deployment.
Participate in code reviews to ensure standards and best practices.
Deploy, monitor, and maintain production systems.
Create and update user stories in backlog, participate in agile scrum ceremonies.
Collaborate with product owner, analysts, architects, QA and other team members The experience you will bring:
Minimum 2-year hands on ETL development experience using DBTMinimum 5+ year hands on experience working with SQL and Snowflake databaseMinimum 1-year hands on experience (not just training or POC) in using Git and PythonStrong communication skills and work in collaborative environments. What will make you stand out:
Hands on Experience in ELT development using Matillion (ingestion tool), DBT (transformation tool) and Snowflake (Database technology)Experience working with Azure Dev Ops, Build and Release CI/CD pipelinesExperience working with AWS and Control MExperience coding complex transformations (not just extract/load mappings) in
III TECHNICAL
SKILLSMust HaveMinimum 1year hands on experience (not just training or POC) in using Git and PythonMinimum 2 year hands on ETL development experience using DBTMinimum 2 year hands on experience working with SQL and Snowflake database Job DescriptionLocation Newport Beach or Charloette Work with technology and business stakeholders to understand data requirementsExposure to data warehousing concepts and must have participated in various implementations building data hubs, data marts etc.Build scalable and reliable data pipelines to support data ingestions (batch and /or streaming) and transformation from multiple data sources such as Flat Files, SQL, AWS RDS, S3 etc. and help centralize the information on Snowflake.
Hands on experience in ingestion, transformation, and database technologies.
Expertise in SQL, complex query writing, query organization, optimization.
Create unit/integration tests and implement automated build and deployment.
Participate in code reviews to ensure standards and best practices.
Deploy, monitor, and maintain production systems.
Create and update user stories in backlog, participate in agile scrum ceremonies.
Collaborate with product owner, analysts, architects, QA and other team members The experience you will bring:
Minimum 2-year hands on ETL development experience using DBTMinimum 5+ year hands on experience working with SQL and Snowflake databaseMinimum 1-year hands on experience (not just training or POC) in using Git and PythonStrong communication skills and work in collaborative environments. What will make you stand out:
Hands on Experience in ELT development using Matillion (ingestion tool), DBT (transformation tool) and Snowflake (Database technology)Experience working with Azure Dev Ops, Build and Release CI/CD pipelinesExperience working with AWS and Control MExperience coding complex transformations (not just extract/load mappings) in