Compare your current skills to what this opportunity needs—we'll show you what you already have and what could strengthen your application.
Job Description
Hi Folks, Hope you are doing well! Please find the below job description and share the updated resumes to
Title:
Lead Data Architect (Migration & Pipeline Architecture)
Work Location:
Charlotte NC, Chandler AZ, Dallas TX (Locals)
Experience:
14+
Years Detailed Job Description:
Role Summary The Lead Data Engineer will be responsible for end ‑ to ‑ end data pipeline architecture , overseeing ingestion, transformation, validation, and migration of cybersecurity baseline data into MongoDB. Key Responsibilities
Architect ingestion and migration pipelines using Python and/or Spark
Design scalable pipelines for Excel, Word, JSON baseline sources
Lead the implementation of data standardization and canonical alignment logic
Define pipeline‑level quality checks, reconciliation mechanisms, and error handling
Ensure performance‑optimized ingestion into MongoDB
Implement lineage capture, auditability, and traceability
Guide engineering team and enforce coding and deployment standards Skills
Python, PySpark, Spark SQL
MongoDB ingestion and performance tuning
Data pipeline architecture & batch processing
Data validation and reconciliation techniques
Cloud‑scale data engineering patterns Experience
10-14+ years in data engineering
Proven experience leading large‑scale data migrations and transformations