Compare your current skills to what this opportunity needs—we'll show you what you already have and what could strengthen your application.
Job Description
Title :
Senior /lead
Data Engineer Location :
Eagan, MN(Need locals only)
Duration :
3-6 months
Rate :
$
Open Relevant Experience:
10+ Years Job Description What are they looking for: Dev Engineer capabilities (this is the core of the role) App dev experience (scripting, especially in python) Expert in AI or Automation (this would be a huge plus)
NOTE:
they understand this might be a unicorn, so these are listed in priority with 2 and 3 being bonuses Skills Proficient in data manipulation and pipeline development Experience processing large datasets in a distributed environment Hands-on experience with Databricks notebooks, workflows, and cluster management Moderate hands-on experience with S3, Lambda, Glue, and EC2 Experience scheduling and automating pipelines Strong SQL skills for complex data extraction and transformation queries Comfortable with version control in a collaborative, shared-repo environment Comfortable creating and managing issues and epics Summary Modernize data pipeline from SAS to Python/PySpark on Databricks. o This Data Engineer will own and evolve our critical HEDIS data pipeline. HEDIS data is delivered to our analytics vendor and used to measure BCBS s performance across key dimensions of care. o This role will initially partner with SMEs during a knowledge transfer period. They will eventually take on pipeline ownership. Regards, Shanthi Pedhiredla