Find Jobs
Find Jobs Near You – Available Work in Your Location
Skip to job details
A
Apollo
Data Engineer
Career Insights for Data Engineer
See where this job fits in the broader career landscape. Knowing your career path helps you see what's possible from here.
Scorecard
Based on New York data
Review key factors to help you decide if this role fits your goals. How is this calculated?
What they do
A Data Engineer designs, builds and manages the information or big data infrastructure. Develops the architecture that helps analyze and process data in the way the organization needs it. Makes sure those systems are performing smoothly.
$115,876 / year median in New York
+8% projected growth
Job Description
Data Engineer Apollo
- 3.6 White Plains, NY Job Details Full-time $80,000
- $90,000 a year 21 hours ago Qualifications Tooling Spark SQL Kafka Python Full Job Description About the Role Apollo is building out a data lake using an already-established medallion architecture, and expanding it as we bring on new clients and migrate existing ones.
- Lead the data lake build-out and expansion using our existing medallion architecture, onboarding both new and existing clients
- Own external data imports as part of client onboarding
- Lead all API-based data imports, ensuring API data is imported directly into the data lake rather than the transactional database
- Design, build, and maintain ETL pipelines using Python
- Write and optimize complex SQL queries against large datasets
- Build web scraping tools to source external data as needed
- Set technical direction and best practices for the team's data engineering work What We're Looking For
- Experience with Azure Synapse (data lake)
- Experience with Azure Data Lake Studio
- Professional SQL experience in a leadership or senior capacity
- Experience building and maintaining ETL pipelines
- ETL experience using Python
- Web scraping experience Nice to Have
- Experience with PySpark
- Experience with Kafka
- Experience with Flink
- Microsoft 365 experience How We Evaluate Our process includes a practical component — we're interested in how quickly you can get up to speed on an existing database/data lake architecture, and we'll ask you to work through some complex SQL queries.
Pay:
$80,000.00- $90,000.