Data Engineer Intern
Job
Insight Global
Oakland, CA (In Person)
Full-Time
Review key factors to help you decide if the role fits your goals.
Pay Growth
?
out of 5
Not enough data
Not enough info to score pay or growth
Job Security
?
out of 5
Not enough data
Calculating job security score...
Total Score
78
out of 100
Average of individual scores
Skill Insights
Compare your current skills to what this opportunity needs—we'll show you what you already have and what could strengthen your application.
Job Description
Job Description The Data Analytics and Insights team is seeking an experienced and talented Senior Data Engineer to join our growing team of analytics experts. As a key member of our team, you will play an essential role in the design, development, and maintenance of data pipelines, analytic products, which includes data applications, reports, and dashboards. We are looking for a proactive, detail-oriented, and motivated individual who can thrive in a fast-paced environment and help us scale our analytic product development to meet our clients' ever-evolving needs. The data engineer will collaborate with our cross functional team including solution architects, data pipeline engineers, data analysts, and data scientists on mission critical initiatives and will ensure optimal delivery of analytic products. You will have a unique opportunity to be at the forefront of the utility industry and gain a comprehensive view of the nation's most advanced smart grid. It is the perfect role for someone who would like to continue to build upon their professional experience and help advance PG&E's sustainability goals.
To learn more about how we collect, keep, and process your private information, please review
- Work closely with Subject Matter Experts (SMEs) to design and develop data model, data pipelines and front end applications.
- Implement data transformations to derive new datasets or create ontology objects necessary for business applications.
- Monitor and debug critical issues such as data staleness or data quality
- Improve on performance of data pipelines (latency, resource usage)
- Implement operational applications
- Maintain applications as usage grows and requirements change.
- Act as scrum delivery team member where applicable, work in collaboration with other Data Engineers / Scientists as needed.
- Help the Product Development Lead Data Analyst / Scientist to design data pipelines and user Interface applications as needed.
- Contribute to creating and maintaining the project backlog in JIRA to design and develop against agreed upon scope by Technical Lead and Product Manager (as applicable).
- Participate in design and specifications, algorithm, data modeling design and the associated research/analysis work and interviewing of SMEs where necessary.
- Develop data pipelines using PySpark to create datasets, Foundry objects, and User Interface applications primarily within the Foundry data mgt & development platform.
- Perform data validations and analysis, use PyTest to create and implement unit test for one time or automated test embedded within a pipeline.
- Implement Foundry Expectations within Foundry Health checks to implement automated validations for build freshness, data freshness, primary key, schema check, but also more complex data validation that should require a build to be aborted or a warning notification.
- Manage your user stories or Tasks in JIRA, split them as needed, document acceptance criteria and progress as needed to provide transparency and enable collaboration.
- Work and deliver against select user stories/tasks following the AKM Product Development lifecycle.
- Help with bug fixes and enhancement requests.
- Join team ceremonies including daily standup, Kanban/Sprint planning, Demos.
- Follow development using an agile approach to focus on business value.
To learn more about how we collect, keep, and process your private information, please review
Insight Global's Workforce Privacy Policy:
https://insightglobal.com/workforce-privacy-policy/. Skills and Requirements Bachelor's Degree in Computer Science, Engineering, or a related field.- 4 years of experience as a data engineer or in a similar role
- Hands-on experience with building data pipelines from ingestion to final object delivery.
- Experience with developing analytic applications, reports, or dashboards
- Experience in using no- and low-code tools for developing analytic applications
- Strong SQL skills and experience working with large datasets and complex data structures.
- Complete proficiency in Python and or Pyspark
- Experience in Typescript (preferred) or Javascript
- Excellent problem-solving and analytical skills with a strong attention to detail.
Similar jobs in Oakland, CA
Amergis Healthcare Staffing, Inc.-Allied
Oakland, CA
Posted2 days ago
Updated1 day ago
Sunbelt Staffing
Oakland, CA
Posted2 days ago
Updated1 day ago
Similar jobs in California
BOTTEGA VENETA
Costa Mesa, CA
Posted2 days ago
Updated1 day ago
Five Star Bath Solutions of Los Angeles
Monrovia, CA
Posted2 days ago
Updated1 day ago
Genentech
South San Francisco, CA
Posted2 days ago
Updated1 day ago