Sr. Data Engineer - W2 Only at Mastech Sr. Data Engineer - W2 Only at Mastech in Cedar Knolls, New Jersey Posted in 13 days ago.

Type:

full-time

Role:

Lead/Sr.

Data Engineer Location:

Parsippany, NJ Type:

Long Term contract Only apply if you are open to w2 + have Databricks expereince.

Responsibilities:

Experience in Data Engineering or Data Platform development. Finance or payroll domain experience, including familiarity with payroll data structures, pay-period logic, compensation and deduction relationships, or financial-services data environments. Experience handling large-scale datasets, including billions of records, multi-terabyte environments, and time-series data. Strong Databricks proficiency with a deep understanding of: Unity Catalog, including governance, access patterns, and catalog/schema design. Delta Lake internals, including optimization, clustering, change data feed, and versioning. Databricks Workflows, including orchestration, dependencies, and monitoring. Databricks Asset Bundles or equivalent deployment frameworks. Experience participating in architecture-level design decisions and evaluating technical tradeoffs.

Strong proficiency in:

Python SQL PySpark Data Modeling ETL/ELT Development Analytical fluency, including exploratory data analysis, basic statistical concepts, distributions, correlations, time-series patterns, and feature engineering. Proficiency with pandas and NumPy for ad hoc analytical work alongside production PySpark. CI/CD implementation experience using tools such as Bitbucket Pipelines, Jenkins, and automated deployment frameworks. You can reach me @ anubhav.agarwal@mastechdigital.com