Pay Growth
?
out of 5
Not enough data
Not enough info to score pay or growth
Find Jobs
Find Jobs Near You – Available Work in Your Location
Skip to job details
TB
TalentVibe Business Consultancy
Data Engineer Lead
Review key factors to help you decide if the role fits your goals.
Job Security
?
out of 5
Not enough data
Calculating job security score...
Total Score
78
out of 100
Average of individual scores
Job Description
Data Engineer Lead TalentVibe Business Consultancy San Ramon, CA Job Details Contract $8,000 - $10,000 a month 2 hours ago Qualifications Performance monitoring Stakeholder engagement Computer Science IT system monitoring Spark Snowflake SQL ETL process automation Production monitoring Linux DevOps automation Cloud monitoring Python Stakeholder relationship building Hadoop Stakeholder management Database software proficiency Full Job Description About the Role We are seeking an experienced Data Engineer Lead to design, develop, and optimize scalable data solutions and pipelines. The ideal candidate will have strong hands-on data engineering expertise combined with the ability to lead technical initiatives, collaborate with stakeholders, and support enterprise-scale data environments. Key Responsibilities Design, develop, and maintain scalable ETL/ELT pipelines for structured and unstructured data. Build and optimize data models, data warehouses, and data processing solutions. Integrate data from APIs, databases, cloud platforms, and other sources. Develop and optimize data pipelines using technologies such as Spark, Hadoop, and Kafka . Ensure data quality, reliability, security, and governance standards. Work with AWS, Azure, or GCP cloud environments and services. Support CI/CD processes using Jenkins, GitHub Actions, GitLab CI/CD, or Azure DevOps . Automate data engineering and operational processes using scripting and other automation tools. Monitor and troubleshoot data platforms and production environments. Use monitoring and observability tools such as Prometheus, Grafana, Datadog, or Splunk . Lead technical discussions and provide guidance to other engineers. Collaborate with architects, DevOps teams, business stakeholders, and other technical teams. Support Agile/Scrum practices and contribute to continuous improvement initiatives. Required Qualifications Bachelor's degree in Computer Science, Information Technology, Engineering, or a related field. 7+ years of experience in Data Engineering or a related technical role. Strong expertise in SQL and Python , with experience in Scala or Java. Hands-on experience with ETL/ELT, Spark, Hadoop, or Kafka . Experience with AWS, Azure, or GCP . Strong understanding of CI/CD tools and practices. Strong Linux, scripting, and automation skills. Experience with monitoring and observability tools. Strong communication, problem-solving, and stakeholder management skills. Preferred Qualifications Experience with Snowflake, Databricks, Redshift, BigQuery, or Synapse . Experience leading distributed technical teams and enterprise-scale deployments. Familiarity with Agile/Scrum methodologies. Relevant cloud or data engineering certifications. Key Skills Data Engineering ETL/ELT | SQL | Python | Spark | Kafka | Cloud | CI/CD | Linux | Automation | Data Platforms | Monitoring & Observability |