Find Jobs
Find Jobs Near You – Available Work in Your Location
Skip to job details
IG
Insight Global
Databricks Engineer
Career Insights for Python Developer
See where this job fits in the broader career landscape. Knowing your career path helps you see what's possible from here.
Scorecard
Based on Massachusetts data
Review key factors to help you decide if this role fits your goals. How is this calculated?
What they do
A Python Developer designs or improves computer software involving Python, an interpreted high-level programming language for general-purpose programming. Oversees the entire software development process.
$126,264 / year median in Massachusetts
+10% projected growth
Job Description
Jobs › Waltham, MA › Databricks Engineer Insight Global Databricks Engineer Waltham, MA Apply Job Description Insight Global is seeking a Databricks Engineer to join a global pharmaceutical organization to assist with a Databricks implementation. In this role, you will stand up and configure Databricks workspaces across dev, test, and production including compute, SQL warehouses, policies, tagging & cost monitoring. You will also implement Unity Catalog governance, and having this exposure will make you a strong fit for the role; This includes catalog & schema design. Additionally, you will be involved in data architecture/modeling by translating solution design into implementation with naming conventions, table design, and incremental load strategy. From a technical perspective, you will hands-on build ingestion pipelines from a mix of Saas, database and file-based sources using Python. It's crucial that this resource comes with hand-on SQL & PySpark experience to re-platform existing report-embedded transformation logic into pipelines. You will be involved in implementing Git-based CI/CD during this project, and repoint existing PowerBI reports onto Databricks. The perfect fit for this role will be someone who has completed a Databricks implementation on a large-scale in the past. We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.
To learn more about how we collect, keep, and process your private information, please review
To learn more about how we collect, keep, and process your private information, please review
Insight Global's Workforce Privacy Policy:
https://insightglobal.com/workforce-privacy-policy/. Skills and Requirements- 3+ years of hands-on Databricks experience in production with 5+ total YOE in data engineering
- 1+ real-world example of end-to-end build from empty workspace to Databricks production pipelines
- Expert-level SQL experience (Window functions, query performance tuning, complex transformation logic)
- Expert-level Python/PySpark experience for pipelines & APIs
- Git, GitHub, or Databricks Asset Bundles
- PowerBI exposure, ideally connected to Databricks
- Experience working in a cloud environment
- Platform foundation experience (
Ex:
Catalogs, schemas, external locations, grants, row-level security, workspace and compute setup, environment strategy)- Bachelors Degree in a related field
- Databricks Certified
- ETL experience
- Lakehouse experience
- Agile framework
- Global team experience Active Filters Databricks Engineer Waltham, MA Clear All Apply
Benefits
- Dental Insurance