Compare your current skills to what this opportunity needs—we'll show you what you already have and what could strengthen your application.
Job Description
INFO SALARY
$150000 - $200000 LOCATION Costa Mesa
JOB TYPE
Permanent Company:
Confidential Location:
Costa Mesa, California, United States Job Type:
Full-Time, Hybrid Compensation:
$150,000 - $200,000 About Our Client Our client is a defense technology company with a mission to transform U.S. and allied military capabilities with advanced technology. By bringing the expertise, technology, and business model of the 21st century's most innovative companies to the defense industry, our client is changing how military systems are designed, built, and sold. Their family of systems is powered by Lattice OS, an AI-powered operating system that turns thousands of data streams into a real-time, 3D command and control center. As the world enters an era of strategic competition, our client is committed to bringing cutting-edge autonomy, AI, computer vision, sensor fusion, and networking technology to the military in months, not years. About the Team As a Senior Software Engineer on the Analytics Team, you will be collaborating with stakeholders across the company to design, build, and implement data pipelines and models that enable our next-generation technology to be deployed around the world. You will have a hand in helping shape the data platform vision at our client. We're looking for software and data engineers who are seeking high-impact, collaborative roles focused on driving operational execution. Ideally, you are looking to learn what it takes to build the next generation of defense technology. What You'll Do Lead the design and roadmap: Take charge of the design and roadmap for the data platform.
Cross-functional partnerships:
Partner with operations, product, and engineering to advocate best practices and build supporting systems and infrastructure for the various data needs.
Own data frameworks:
Manage the ingest and egress frameworks for data pipelines that stitch together various data sources to produce valuable data products that drive the business.
Palantir Foundry management:
Utilize Palantir Foundry as the central hub for data-driven applications, visualizations, and large-scale data analysis across our client's organization. Manage a large user base and provide true data self-service at scale.
Data transformations:
We use SQLMesh for data transformations, giving engineers the ability to work with SQL while enjoying software engineering best practices like version control, testing, and CI/CD for data pipelines.
Data lake analytics:
For querying data, we utilize AWS Athena, an AWS serverless solution that allows the team to run analytics directly on the data lake without managing infrastructure.
Table formats:
We have implemented Apache Iceberg as our table format, providing advanced data management capabilities like schema evolution and time travel queries.
Orchestration:
We use Flyte for orchestration; it is a highly scalable, Kubernetes-native modern orchestration platform similar to Airflow or Dagster.
Qualifications Experience:
5+ years of experience in a data engineering role building products, ideally in a fast-paced environment.
Mission Alignment:
You are motivated by our client's mission; they are working to solve the biggest problems in defense.
Programming Foundations:
Good foundations in Python or another language.
Technical Tools:
Experience with Spark, PySpark, SQL, and dbt.
Enterprise Data Systems:
Experience with Enterprise Data Systems like Palantir Foundry.
Data Services & Products:
Experience with or interest in learning how to develop data services and data products.
Cloud & Ecosystems:
Experience with AWS, Azure, or GCP security ecosystems, containerization, and associated tooling.
Data Visualization:
Knowledge of data and visualization tools, such as Tableau.
Security Awareness:
Understand the importance of engineering with security's best practices in mind.
Soft Skills:
You are empathetic (eager to see the world from your users' perspective), a self-starter, and energized by business impact to drive the direction of ambiguous projects.
Ownership:
Drive to take ownership of and debug complex data transformation pipelines and data models.
Citizenship Requirement:
Must be a U.S. Person due to required access to U.S. export-controlled information or facilities. CONTACT Anthony Goodvin Sourcing Consultant
