Senior Data Engineer
Job
Mindlance
Remote
Full-Time
Review key factors to help you decide if the role fits your goals.
Pay Growth
?
out of 5
Not enough data
Not enough info to score pay or growth
Job Security
?
out of 5
Not enough data
Calculating job security score...
Total Score
79
out of 100
Average of individual scores
Skill Insights
Compare your current skills to what this opportunity needs—we'll show you what you already have and what could strengthen your application.
Job Description
Senior Data Engineer#26-12907
Reston, VA
Fully Remote Job Description Position Title:
Senior Data EngineerLocation:
RemoteDuration:
Contract to hireProfile :
Data Quality Engineer (AWS Data Platform) Overview We are seeking a highly skilled Data Engineering- Quality Engineer to define and implement end-to-end testing strategies for a modern data platform built on AWS.
Must Have Skills:
AWS- CloudFormation AWS
- Dynamo AWS
- Lambda AWS
- S3 AWS
- SNS/SQS AWS Step Function BI Tool Gen AI Node.
Role:
The Assistant Director, Strategic Higher Education-Enrolment Leadership (Temporary) provides high-level, confidential administrative and logistical support to ensure smooth daily operations and to facilitate flawless execution of member-focused engagements. This position plays a key role within the SHE unit, with responsibilities closely aligned to existing full-time assistant director roles. This position carries limited responsibility for budget planning, forecasting. Reporting to the Executive Director, this role manages complex calendars, meetings, communications, travel, and materials for internal and external engagements hosted by SHE. Serving as a trusted partner and key point of contact for SHE, the Assistant Director anticipates needs, solves problems proactively, and helps unit leaders stay focused on their most critical work while maintaining alignment across priorities in collaboration with Assistant Directors and the Senior Director for Strategic Higher Education.Team:
Team is Client delivery platform and Cumulus- lots of data exchanges: AWS platform using Redshift as data warehouse
- Dynamo of meta-data.
Responsibilities:
Define the end-to-end testing scope based on solution architecture and project documentation Design and implement a comprehensive testing strategy and plan aligned with organizational QA standards Develop and maintain test scripts and frameworks for the Redshift serverless platform Perform testing across key technologies, including: AWS Redshift AWS DMS (Data Migration Service) AWS Glue PySpark Deequ Event Bridge Data Lakes Python-based data pipelines Apache Airflow dbt (data build tool) Build and implement automated testing solutions to ensure: End-to-end data validation Data ingestion accuracy Transformation logic integrity Data pipeline reliability Conduct test coverage analysis and ensure adequate validation across all data engineering workflows Prepare and manage test data Review and provide feedback on: Solution architecture Data models Design and technical documentation Collaborate with cross-functional teams (Data Engineering, BI, DevOps, Product) to: Identify testing impacts Mitigate risks Ensure high-quality deliverablesRequired Skills:
Proven experience in data engineering testing / dataQA / ETL
validation Strong hands-on experience with AWS data services (Redshift, Glue, DMS) Proficiency in Python for test automation and validation Experience with Airflow and orchestration testing Hands-on experience with dbt and data transformation validation Familiarity with CDK for infrastructure validation Experience in BI testing in Quicksuite will be highly beneficial Experience with data quality tools such as PySpark Deequ or similar Strong understanding of: Data warehousing concepts ETL/ELT pipelines Data validation techniques (schema, reconciliation, anomaly detection)Preferred Qualifications:
Experience designing enterprise-level test strategies for data platforms Knowledge of CI/CD pipelines for data and test automation Experience working in Agile / Scrum environments Familiarity with data observability frameworks.EEO:
"Mindlance is an Equal Opportunity Employer and does not discriminate in employment on the basis of- Minority/Gender/Disability/Religion/LGBTQI/Age/Veterans.
Similar remote jobs
UnitedHealth Group
Fort Wayne, IN
Posted2 days ago
Updated6 hours ago
Similar jobs in Reston, VA
Stanley Martin Homes
Reston, VA
Posted2 days ago
Updated6 hours ago
Similar jobs in Virginia
DNI Delaware Nation Industries
Alexandria, VA
Posted2 days ago
Updated6 hours ago
Virginia Zoological Society
Norfolk, VA
Posted2 days ago
Updated6 hours ago