Job Description Insight Global is seeking a Databricks Architect who will serve as the most senior data engineering resource on the team, responsible for owning the Databricks platform end-to-end. The ideal candidate is a true Databricks expert with deep, hands-on experience implementing and managing environments, not just building pipelines. This role will focus on designing and delivering scalable data solutions, working closely with business stakeholders to translate requirements into actionable data pipelines and architecture. The candidate will lead Databricks initiatives, ensure data quality and integrity, and collaborate with a small team of engineers to execute high-priority use cases. This is a highly visible role with strong ownership and impact, ideal for someone who thrives in a hands-on, fast-paced environment and can bridge both technical and business needs.
Day-to-Day:
- Lead Databricks architecture, setup, and ongoing administration
- Design and build scalable ETL/ELT data pipelines
- Partner with business stakeholders to gather requirements and define data solutions
- Map data flows and ensure data quality, testing, and validation processes
- Collaborate with internal developers and data engineers to execute builds and implementations
- Act as a technical lead for Databricks initiatives within a small, flat team structure
- Support rapid delivery of business-driven use cases and dashboards
- Provide guidance on best practices for data engineering and cloud-based data platforms We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day.
We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.
To learn more about how we collect, keep, and process your private information, please review
Insight Global's Workforce Privacy Policy:
https://insightglobal.com/workforce-privacy-policy/. Skills and Requirements
- Strong, hands-on Databricks experience with proven experience implementing and maintaining Databricks environments
- Experience with ETL/ELT pipeline development from scratch
- Strong understanding of data engineering concepts, data modeling, and data transformations
- Proficiency in Python and SQL
- Experience working in a cloud environment (AWS, Azure, or GCP)
- Strong communication skills and ability to work cross-functionally with business stakeholders
- Experience with dbt (Data Build Tool)
- Experience with Fivetran