Data Engineer

Data Engineer at Horizontal Talent Data Engineer at Horizontal Talent in Minneapolis, Minnesota Posted in about 23 hours ago. $51.00 - $89.00 per hour

Job Description:

Join our dynamic team as a Data Engineer, where you'll be instrumental in transforming unstructured data and building forward-thinking solutions. This role offers a unique chance to innovate with cutting-edge technologies and make a significant impact. Responsibilities Design and construct pipelines to ingest, parse, and convert diverse unstructured data. Develop scalable workflows using advanced tools and frameworks for document processing. Collaborate with AI engineers to optimize data corpora for AI-driven applications. Implement systems for querying financial data using natural language. Create and maintain APIs ensuring seamless data and model integration. Skills Five or more years of experience in data engineering, with specialized skills in Databricks technologies. Expertise in handling unstructured data and creating effective embedding pipelines. Proficient in PySpark, Python, and SQL, particularly within Databricks environments. Solid knowledge of

REST API

development and microservices architecture. Understanding of data modeling principles and governance practices. Preferred Skills Experience with Azure integrations enhancing Databricks capabilities. Exposure to orchestration frameworks and vector databases. Background or familiarity with data in financial or investment banking sectors. Certification in data engineering or related fields could be a plus. At Horizontal, diversity, equity, and inclusion are fundamental to our hiring strategy and workplace culture. We welcome candidates from all backgrounds to enhance our innovative team. By applying for this position, you acknowledge and agree that Horizontal Talent may contact you regarding your application using automated technology, including phone calls, SMS/text messages, or email, which may be delivered by our virtual AI recruiter, Alex. Horizontal facilitates valuable and productive conversations between you and potential employers. We can assist you in growing your career by partnering you with employers that offer challenging assignments. For those that join the team, we offer competitive compensation and benefits including medical, dental, vision, and retirement. Check out all we have to offer and how you can become part of the Horizontal Talent Team. The pay range for this role is $51 - $89 per hour. This is not a guarantee of compensation, as final offer amount may vary based on factors including but not limited to experience and geographic location.