Apply for this opportunity

This job application is on an outside website. Be sure to review the job posting there to verify it's the same.

Apply Offsite

Lead Data Engineer

Job

ConnectedX, Inc.

Plano, TX (In Person)

Full-Time

Posted 2 days ago (Updated 6 hours ago) • Actively hiring

Expires 7/4/2026

See Job Scorecard

Review key factors to help you decide if the role fits your goals.

How is this calculated?

Pay Growth

out of 5

Not enough data

Not enough info to score pay or growth

Job Security

out of 5

Not enough data

Calculating job security score...

Total Score

out of 100

Average of individual scores

Were these scores useful?

Skill Insights

Compare your current skills to what this opportunity needs—we'll show you what you already have and what could strengthen your application.

Job Description

Need Consultants local to Plano, TX.

Job Title:

Lead Data Engineer Location:

Plano, TX Onsite Duration:

12+ Months W2

Contract Job Description:

Need highly skilled Lead Data Engineer to design, build, and optimize scalable data platforms and pipelines in a cloud-native environment. The candidate will have deep expertise in modern data engineering practices, distributed data processing, cloud architecture, and data governance. This role requires strong technical leadership, hands-on engineering capabilities, and the ability to mentor teams while driving best practices across enterprise data platforms. Key Responsibilities Lead the design, development, and optimization of large-scale data pipelines and data platforms. Architect and implement high-performance batch and real-time data processing solutions using Spark and cloud-native technologies. Drive data engineering best practices, coding standards, performance tuning, and operational excellence. Design and maintain metadata-driven frameworks to improve scalability, reusability, and maintainability of data solutions. Handle complex Change Data Capture (CDC) implementations and troubleshoot edge cases across heterogeneous source systems. Resolve sparse column ingestion challenges and ensure data consistency, quality, and reliability across data platforms. Implement robust monitoring, observability, and failure recovery mechanisms for distributed systems. Collaborate with Data Architects, Data Scientists, Analysts, and Business stakeholders to deliver data-driven solutions. Lead cloud integration initiatives, including secure cross-account AWS connectivity and data sharing. Establish and enforce data governance, security, lineage, and access control policies using Unity Catalog and related governance tools. Mentor junior and senior engineers and provide technical leadership for project delivery. Required Skills & Qualifications 12+ years of IT experience with at least 5+ years in Big Data/Data Engineering. Strong expertise in Scala programming and Apache Spark (RDD, DataFrames, Spark SQL). Hands-on experience with Databricks and AWS ecosystem. Experience with Workday HCM integrations, including data extraction and transformation. Proficiency in SQL and data modeling concepts. Experience in ETL tools, especially Informatica PowerCenter, and migration strategies. Strong understanding of data pipeline architecture and distributed systems. Proven experience in project management and team leadership. Excellent communication and stakeholder management skills. Candidate should become strong in below areas: Spark optimization Data Engineering fundamentals CDC edge cases Sparse column ingestion issues Metadata-driven frameworks Cross-account AWS integration Unity Catalog governance Distributed system failures