IDF Dataflow Analyst

IDF Dataflow Analyst SFI is seeking an IDF Dataflow Analyst to support a large-scale data modernization initiative transitioning legacy, on-premise systems into a centralized, high-availability cloud data platform. This role is part of a Dataflow Team that serves as the critical bridge for the movement of real-time, high-volume data across a complex enterprise environment. Over the next 6-12 months, the primary focus will be on supporting the development and population of a centralized, real-time data repository designed to enable scalable data access, advanced analytics, and future AI/ML capabilities. Key Responsibilities

• Support the ingestion and migration of large-scale datasets into a cloud-based data platform
• Assist in modernizing legacy dataflow pipelines into automated, cloud-native solutions
• Maintain high availability and reliability of real-time data delivery across hybrid environments
• Monitor, troubleshoot, and optimize data ingestion and routing processes Primary Responsibilities

Data Lifecycle Management:

Manage the end-to-end flow of real-time data, including validation, quality control, archival, and retrieval

Cloud Data Ingest Support:

Execute and support ingestion processes for mission-critical datasets into the cloud environment

Pipeline Modernization:

Assist in transitioning legacy workflows into API-driven and automated scripting solutions (Python/Bash)

Operational Monitoring & Support:

Ensure continuous data flow in a 24/7 environment; troubleshoot and resolve data delivery issues

System Integration & Performance:

Monitor and optimize data routing applications and cloud services to ensure performance and low latency

Scripting & Maintenance:

Maintain and enhance scripts and legacy tools (Bash, Perl, SQL) while supporting migration to modern solutions

CI/CD & Automation:

Support automated deployment, testing, and monitoring of dataflow applications and pipelines

• Tier 2

Support:

Serve as a technical escalation point for complex data ingestion and formatting issues

Documentation:

Develop and maintain technical documentation, processes, and configuration standards

On-Call Support:

Participate in a 24/7 on-call rotation to support mission-critical operations

Stakeholder Collaboration:

Work with internal teams and external partners to resolve data access, formatting, and integration challenges Requirements Education & Experience

• Bachelor's degree in Computer Science, Information Systems, or related field (or equivalent experience)
• 5-8 years of experience in a technical, data, or systems support role
• 1-2 years of hands-on experience with cloud platforms (AWS, Azure, or GCP)
• Strong scripting experience in Python and Bash (Perl experience a plus)
• Experience supporting data pipelines, ETL processes, or system integrations
• Familiarity with CI/CD tools and automated workflows
• Minimum 2 years of Linux/Unix system administration or support experience
• Ability to obtain and maintain a Public Trust clearance Desired Skills & Qualifications

Meteorological Domain Expertise:

Experience working with scientific data dissemination and observation systems within NOAA, NASA, or Department of Defense environments; familiarity with standard meteorological data formats such as METAR, TAF, GRIB, and BUFR.

System Monitoring:

Hands-on experience with enterprise monitoring tools, including Big Brother, Nagios, or cloud-native solutions (e.g., Amazon CloudWatch) to ensure system performance, availability, and reliability.

Database Management:

Proficiency in SQL and a strong understanding of relational database design, querying, and maintenance.

Version Control:

Experience using version control and change management tools such as Git, Subversion (SVN), or similar platforms. Certifications Required (one of the following)

• One foundational or associate-level cloud certification (e.g., AWS Certified Cloud Practitioner or equivalent) Desired
• Advanced cloud certifications

Additional Information:

Clearance:

Must be authorized to work in the U.S.

• Background checks may include Criminal History, Education Verification, Employment Verification, Professional Certifications, and Credit History. (Public Trust investigations typically take 4-8 weeks and require fingerprinting.)

Work Environment:

Remote

Salary Range:

$65,000 - $100,000 annually

Benefits:

SFI offers a comprehensive benefits package. Details available at SFI Careers.

• This is a full-time, W2 position.
• No agencies, third parties, or Corp-to-Corp submissions.
• Spatial Front Inc. is an Equal Opportunity Employer — all qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, or protected veteran status.
• SFI participates in E-Verify.

Salary Description $65,000.00 - $100,00.00 annually