NIFI Dataflow Engineer

CCS Global Tech is a rapidly growing Information Technology company with a diverse portfolio of technology products and services and a large network of industry partnerships. With over 22 years of being a successful business with a global talent pool and presence, CCS is a certified Microsoft Gold Partner and specializes in delivering expert Microsoft based solutions for technical and business needs. We have been recognized by Inc. 500 Magazine as one of the fastest growing small companies in the Unites States. we are a Tier 1 vendor for the City and County of San Francisco for Cloud Services, Staffing Services and Training Services. For this multi-year opportunity with a diverse set of needs to address, we are currently focusing on establishing partnerships with individuals as well as companies who can help us enhance our overall service portfolio, cut lead times, and ultimately help us deliver successfully. We currently hold sizable Government accounts in the San Francisco bay area including City and County of San Francisco, San Mateo County, and Santa Clara County. We take great pride in our global reach and local influence. Your experience alongside our highly skilled and talented internal team who guide you along the way, offers key insights into what helps you stand out in a competitive job market. If you are a partner company, please submit resumes with contact information of your own W2 Consultants only . Submitted consultants are expected to have excellent communication skills.

Job Title:

NIFI Dataflow Engineer Clearance:

FSP Location:

Annapolis Junction, MD Salary:

$220K-$240

K Yearly Job Summary:

The idea candidate for this job would be responsible for designing, implementing, and managing dataflows. The candidate will maintain data pipelines, ensuring secure and efficient data movement using NiFi clusters. Responsibilities also include optimizing flow performance, monitoring and troubleshooting. This role will require some Linux skills for basic server administration and NiFi management as well as collaborating with system engineers, data scientist and cross-functional teams to understand data needs and translate them into NiFi workflows.

Key Responsibilities and Duties Pipeline Development:

Design, implement, and maintain complex data pipelines and flows within the Apache NiFi environment.

Data Management & Integration:

Manage data ingestion, transformation, and distribution between various systems, including cloud platforms such as AWS.

System Performance Tuning:

Optimize NiFi flows, configure processors, set backpressure, and manage NiFi cluster resources for high performance. Implement data security and compliance measures

Troubleshooting & Monitoring:

Monitor flow performance using NiFi's Data Provenance capability to debug, trace data flow issues, and ensure data integrity and availability.

Documentation:

Create detailed architectural diagrams, documentation for data flows, and technical support documentation. Participate in on-call rotations to provide 24/7 support Qualifications in addition to meeting position description needs. Seventeen (17) year's experience as a SE in programs and contracts of similar scope, type and complexity is required. Bachelor's degree in System Engineering, Computer Science, Information Systems, Engineering Science, Engineering Management, or related discipline from an accredited college or university is required. Five (5) years of additional SE experience may be substituted for a bachelor's degree