Data engineer Position Available In Hillsborough, Florida
Tallo's Job Summary: Data engineers with 3+ years of experience are needed to utilize SQL, ETL, Python/Java programming, Agile methodologies, and BDD/TDD in data warehousing. Responsibilities include creating automated data quality tests, implementing monitoring systems, and collaborating with teams to improve data processes. Employers recruiting for this position have AI-generated job descriptions for accuracy.
Job Description
Data engineer
Candidate should be able to carry out the job below and have 3+ years of experience in below technical skills.
Technical skills – 1. Advanced
SQL 2. ETL
Data warehousing 3. Programming (Python/Java) 4. Agile methodologies 5.
BDD/ TDD
Design and Develop Automated Data Quality Tests:
Create and maintain automated test scripts and frameworks for data quality validation using tools like Python, SQL, and data quality testing frameworks.
- Develop data profiling and validation rules to identify data anomalies and inconsistencies.
Build and maintain test data sets for various testing scenarios.
Implement Data Quality Monitoring and Alerting:
- Integrate automated data quality tests into CI/CD pipelines for continuous testing.
- Set up data quality monitoring dashboards and alerts to proactively identify data issues.
- Develop and maintain data quality reports and metrics.
Collaborate and Improve Data Quality Processes:
- Work closely with data engineers and product owners to understand data pipelines and requirements.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
Report this job
Dice Id:
10114746
Position Id:
8636689
