Tallo logoTallo logo

Prompt Engineer/LLM Specialist - Support & Innovation

Job

Compunnel, Inc.

New York, NY (In Person)

Full-Time

Posted 8 weeks ago (Updated 7 weeks ago) • Actively hiring

Expires 5/27/2026

Apply for this opportunity

This job application is on an outside website. Be sure to review the job posting there to verify it's the same.

Review key factors to help you decide if the role fits your goals.
Pay Growth
?
out of 5
Not enough data
Not enough info to score pay or growth
Job Security
?
out of 5
Not enough data
Calculating job security score...
Total Score
85
out of 100
Average of individual scores

Were these scores useful?

Skill Insights

Compare your current skills to what this opportunity needs—we'll show you what you already have and what could strengthen your application.

Job Description

Job Summary The Prompt Engineer/LLM Specialist - Support & Innovation is responsible for building production-grade large language model (LLM) systems that go far beyond prompt writing. This role focuses on designing and evaluating prompts, developing testing pipelines, orchestrating LLM-based workflows, ensuring system reliability, and supporting innovation initiatives. The specialist will work with evaluation frameworks, RAG architectures, and Python-based automation to maintain high-quality LLM performance in production environments. Key Responsibilities Design and optimize prompts for LLM systems using systematic evaluation methods. Build Python pipelines to support prompt testing, scoring, and evaluation. Architect, refine, and optimize Retrieval-Augmented Generation (RAG) pipelines. Implement orchestration for LLM workflows, including tool usage and agent-based systems. Monitor and improve LLM performance, quality, drift behavior, and failure modes. Document best practices, evaluation outcomes, and system improvements. Support innovation initiatives involving prompt engineering, LLM usage, and applied AI development. Required Qualifications 4+ years of experience in AI, machine learning, natural language processing, or related fields. Strong proficiency in Python development. Hands-on experience working with LLMs, embeddings, and vector databases. Experience deploying LLM systems into production environments. Preferred Qualifications Experience with agentic AI frameworks. Strong background in LLM evaluation, observability, and quality monitoring. Experience with GenAI solutions in financial services or similar regulated industries.

Similar remote jobs

Similar jobs in New York, NY

Similar jobs in New York