Job Description Our Agent Software and Advertising organization is seeking a Senior Data Engineer to support the development of next-generation software and advertising products that power the real estate industry. This role will focus on designing and maintaining highly scalable data pipelines, developing robust data models, and enabling data-driven decision making across product, engineering, sales, marketing, operations, and support teams. The ideal candidate will have strong hands-on experience with Spark, Airflow, Python, and SQL, along with a proven track record building large-scale, production-grade data platforms processing billions of rows of data. Experience with cloud platforms and Databricks is highly preferred. Candidates who thrive in collaborative environments, enjoy solving complex business problems, and are passionate about automation, data quality, scalability, and engineering best practices will be successful in this role. Skills and Requirements A degree (BS+) in Computer Science or a related field5+ years of experience building and maintaining data-intensive applications.
Experience developing sophisticated data pipelines scaling to billions of rows with production quality deployment, monitoring and reliabilityExperience with DatabricksExtensive experience with modern data technologies such as Spark and Airflow.
Strong proficiency in programming languages such as Python, Java, or Scala.
Extensive experience with SQLProven data modeling experience, translating business requirements into clean and easily evolvable data models.
Excellent interpersonal skills and a passion for collaborating across organizational boundaries. We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal employment opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment without regard to race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or the recruiting process, please send a request to HR@insightglobal.com.