Data Engineer

Data Engineer at TekWissen ® Data Engineer at TekWissen ® in Plano, Texas Posted in 1 day ago.

Type:

full-time

Job Description:

Position:

Data Engineer Location:

Frisco, TX, Overland Park, KS Duration:

6+

Months Work Type:

Onsite Payrate:

$50.00 - 50.00/hr.

Overview:

TekWissen is a global workforce management provider headquartered in Ann Arbor, Michigan that offers strategic talent solutions to our clients world-wide. Our client provider of digital technology and transformation, information technology and services

Job Description:

The enriched datasets are consumed by multiple downstream systems and teams, including the Customer Data Platform (CDP) and other analytics/research stakeholders. The platform is Azure-native and built primarily on Databricks (processing + some ML workloads) and Snowflake (analytics/warehouse). A major focus is building reliable, governed, vendor agnostic datasets while ensuring privacy/compliance, data governance, and cost efficiency.

Key Responsibilities:

As a Data Engineer, you will: Data Ingestion & Pipeline Development Build and enhance ingestion pipelines for large batch and event-driven paths .

Integrate data from:

Third party enrichment vendors Digital platforms via Conversion API integrations Rewards/Promotions systems for offer issuance/redemption/consumption data Data Quality, Reliability & Operations Implement strong data validation, idempotency, replay/backfill strategies, and deduplication to prevent quality drift. Own monitoring, alerting, dashboarding, and operational readiness. Troubleshoot failures with root cause analysis not just reruns: Interpret Spark logs Diagnose performance issues Improve stability and SLA adherence Governance & Compliance Apply privacy, compliance, and governance requirements across pipelines and datasets.

Support governance standards such as:

Unity Catalog, lineage, access controls Managing PII vs non PII access Documentation of tables, schemas, catalogs, and cluster usage Cost Governance & Performance Optimization Design pipelines with cost awareness from day one: Cluster sizing, workload tuning, efficient compute/storage usage Trade-off decisions balancing cost vs quality vs SLA Collaboration & Ownership Work in a small, fast-moving team; be self-driven and ownership-oriented. Raise and manage data quality escalations when issues are detected. Contribute to evolving architecture (product is early-stage; first live month was recent).

Must-Have Skills :

Recruiters should prioritize candidates with hands-on, Recent experience in: Strong coding: PySpark +

SQL Databricks:

notebooks/jobs, performance tuning fundamentals, medallion patterns Spark fundamentals: partitioning, skew/shuffle optimization, understanding failures via logs

Snowflake:

data modeling/usage for analytics/warehousing workloads Azure ecosystem: Azure Data Factory Azure-native integrations and services exposure Data engineering reliability patterns: validation, idempotency, replay/backfills, dedup, Auditability Data governance: Unity Catalog lineage, access control patterns. TekWissen® Group is an equal opportunity employer supporting workforce diversity.