AI Software Engineer III

AI Software Engineer III at RxBenefits in Boise, Idaho, United States Job Description RxBenefits is hiring! We are adding a Software Engineer III to the growing application development team at our Birmingham, AL headquarters. As a level III engineer, you will be responsible for creating the next generation of software at RxBenefits to support our rapidly growing business. You will also be a thought leader across the technology organization that champions the delivery of modern software. This is an exciting opportunity for a forward-thinking professional that is able to conceptualize, deliver, and support the technology that our employees and partners need to succeed.

Essential Job Responsibilities Include:

+ Design, build, and maintain AI-driven backend services, APIs, pipelines, and application features. + Design AI pipelines with secure data handling, PII/PHI protection, redaction, and access-control-aware processing. + Design and implement document ingestion pipelines (PDFs, scans, images, email attachments). + Design evaluation frameworks for extraction accuracy, retrieval relevance, and LLM output quality. + Build document classification, entity extraction, and schema mapping workflows. + Implement OCR and layout-aware extraction pipelines. + Develop confidence scoring, human-in-the-loop workflows, and validation mechanisms. + Build systems that route extracted data into downstream enterprise systems. + Build connectors and ingestion pipelines for structured and unstructured systems (e.g., Confluence, file stores, databases). + Implement chunking, indexing, and metadata enrichment strategies. + Design retrieval strategies including hybrid search (vector + keyword). + Improve relevance via ranking, filtering, and contextualization. + Implement monitoring and observability for AI systems, including model performance, retrieval quality, extraction accuracy, and drift detection. + Partner with Product, Data, and Architecture teams to translate business problems into efficient AI solutions. + Participate in the design process to build efficient, scalable and maintainable architecture. + Research, evaluate and recommend alternative solutions. + Build scalable services integrating LLMs, retrieval systems, model inference endpoints, and third-party AI providers. + Ensure solutions meet enterprise standards for reliability, security, compliance, and observability. + Collect and analyze metrics to drive implementation decisions. + Design, improve and document processes. + Review and collaborate with other engineers on the

Job Posting:

JC291512763

Posted On:

May 07, 2026

Updated On:

May 07, 2026