100% Remote-Data Engineer

NOTE:

THIS IS A 100

% Remote role. Senior Data Engineer Must Haves Strong hands-on experience building and supporting production-grade data pipelines using PySpark and Apache Spark Extensive experience working within Databricks environments Experience with Databricks Unity Catalog migrations and modernization initiatives Experience with Databricks Unity Catalog governance and security models Strong understanding of ETL/ELT design, data modeling, and incremental data processing Experience modernizing legacy data platforms and data migration projects Experience working with large-scale datasets in cloud-based data platforms Experience with workflow orchestration, scheduling, and pipeline automation Knowledge of cloud data platforms such as Snowflake and/or Google Cloud Experience implementing data quality checks, monitoring, logging, and alerting Strong troubleshooting, collaboration, and problem-solving skills Responsibilities Migrate existing data assets and pipelines to Databricks Unity Catalog Refactor and optimize existing pipelines using modern engineering standards and best practices Build and maintain scalable PySpark-based data pipelines Develop new source-of-truth datasets and modernize legacy data workflows Design and implement workflow orchestration using Databricks Jobs Deploy and manage pipelines using Databricks Asset Bundles Ensure data pipelines are reliable, observable, and production-ready Implement data quality controls, monitoring, and operational alerting Support platform migrations, testing, validation, and production cutovers Partner with engineering teams to improve platform stability, scalability, and data reliability Nice to Have Familiarity with advertising, analytics, measurement, or large-scale data ecosystems Experience with CI/CD and DataOps best practices for data engineering environments Beacon Hill is an equal opportunity employer and individuals with disabilities and/or protected veterans are encouraged to apply.

California residents:

Qualified applications with arrest or conviction records will be considered for employment in accordance with the Los Angeles County Fair Chance Ordinance for Employers and the California Fair Chance Act. If you would like to complete our voluntary self-identification form, please or copy and paste the following link into an open window in your browser: ;/p> Completion of this form is voluntary and will not affect your opportunity for employment, or the terms or conditions of your employment. This form will be used for reporting purposes only and will be kept separate from all other records.

Company Profile:

Beacon Hill Technologies, a premier National Information Technology Staffing Group, provides world class technology talent across all industries utilizing a complete suite of staffing services. Beacon Hill Technologies' dedicated team of recruiting and staffing experts consistently delivers quality IT professionals to solve our customers' technical and business needs. Beacon Hill Technologies covers a broad spectrum of IT positions, including Project Management and Business Analysis, Programming/Development, Database, Infrastructure, Quality Assurance, Production/Support and ERP roles. Learn more about Beacon Hill and our specialty divisions, Beacon Hill Associates, Beacon Hill Financial, Beacon Hill HR, Beacon Hill Legal, Beacon Hill Life Sciences and Beacon Hill Technologies by visiting .

Benefits Information:

Beacon Hill offers a robust benefit package including, but not limited to, medical, dental, vision, and federal and state leave programs as required by applicable agency regulations to those that meet eligibility. Upon successfully being hired, details will be provided related to our benefit offerings. We look forward to working with you. Beacon Hill. Employing the Future