Senior Data Pipeline Engineer

Senior Data Pipeline Engineer

Job Title:

Senior Data Pipeline EngineerJob Category:

EngineeringTime Type:

Full timeMinimum Clearance Required to

Start:

TS/SCI with

PolygraphEmployee Type:

RegularPercentage of Travel Required:

NoneType of Travel:

NoneThe OpportunityJoin our dynamic team as we revolutionize enterprise security with our Secure the Enterprise initiative. We are seeking a skilled professional to help us transition from a manual system security evaluation and authorization process to a cutting-edge model that leverages automation, streamlined processes, continuous monitoring, and comprehensive network data gathering. This role offers an exciting opportunity to make a significant impact on our organization's security posture and operational efficiency.

Responsibilities

• Data Integration:

  Seamlessly integrate data with tools such as Amazon S3, MongoDB, Apache Spark, and Elasticsearch

• NiFi Cluster Optimization:

  Enhance NiFi cluster architecture, performance tuning, and data pipeline strategies

• Dataflow Design:

  Design, implement, and troubleshoot dataflows using Apache NiFi, including processors, connections, and templates

• Cloud Deployment:

  Deploy and manage NiFi in cloud environments (AWS, Azure, GCP) and utilize cloud-native tools for data processing

• Infrastructure Management:

  Oversee continuous integration, environment configuration, and deployment while supporting project compliance and security

• Automation Delivery:

  Focus on delivering automation solutions that enable other teams to operate more efficiently

•

Workflow Tracking:

Experience tracking work through JIRA workflows.

Required Qualifications

• Active TS/SCI w/ Polygraph
• Education and Experience
• 12 years minimum experience with a high school diploma/GED
• 10 years minimum experience with an Associate's Degree
• 8 years minimum experience with a Bachelor's degree
• 6 years minimum experience with a Master's degree
• 4 years minimum experience with a Doctorate's degree
• All experience and education must be in a technical field directly related to the labor category and obtained from accredited institutions

• Linux System Administration:

  Experience with Centos7 or RedHat8

• NiFi Cluster Administration:

  Proven experience administering a NiFi cluster

• Containerization:

  Experience with Docker
• Infrastructure as

Code:

Experience with Terraform

• Apache NiFi Proficiency:

  Hands-on experience designing, implementing, and troubleshooting dataflows using Apache NiFi

• NiFi Expression Language:

  Strong understanding of leveraging NiFi Expression Language for dynamic dataflows

• Data Integration:

  Experience with tools like Amazon S3, MongoDB, Apache Spark, and Elasticsearch

• Performance Optimization:

  Knowledge of NiFi cluster architecture and performance tuning strategies

• Cloud Integration:

  Expertise in deploying and managing NiFi in cloud environments

• Scripting and Automation:

  Proficiency in scripting languages like Python, Groovy, or Bash.Desired Qualifications

• Cloud Hosting and Automation:

  Experience in cloud hosting and automation

• Agile Environment:

  Experience working in an Agile environment

•

What You Can Expect:

A culture of integrity.

At CACI, we place character and innovation at the center of everything we do. As a valued team member, you'll be part of a high-performing group dedicated to our customer's missions and driven by a higher purpose

• to ensure the safety of our nation.

An environment of trust.

CACI values the unique contributions that every employee brings to our company and our customers

• every day.

You'll have the autonomy to take the time you need through a unique flexible time off benefit and have access to robust learning resources to make your ambitions a reality.

A focus on continuous growth.

Together, we will advance our nation's most critical missions, build on our lengthy track record of business success, and find opportunities to break new ground

• in your career and in our legacy.

Pay Range :

T are a host of factors that can influence final salary including, but not limited to, geographic location, Federal Government contract labor categories and contract wage rates, relevant prior work experience, specific skills and competencies, education, and certifications. Our employees value the flexibility at CACI that allows them to balance quality work and their personal lives. We offer competitive compensation, benefits and learning and development opportunities. Our broad and competitive mix of benefits options is designed to support and protect employees and their families. At CACI, you will receive comprehensive benefits such as; healthcare, wellness, financial, retirement, family support, continuing education, and time off benefits.

The proposed salary range for this position is:$113,200

• $237,800CACI is an Equal Opportunity Employer.

All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, pregnancy, sexual orientation, age, national origin, disability, status as a protected veteran, or any other protected characteristic.