Find Jobs
Find Jobs Near You – Available Work in Your Location
Software Engineer in Test
Career Insights for Generative Artificial Intelligence Engineer
See where this job fits in the broader career landscape. Knowing your career path helps you see what's possible from here.
Scorecard
Based on Massachusetts data
Review key factors to help you decide if this role fits your goals. How is this calculated?
What they do
A Generative Artificial Intelligence Engineer develops, designs, and manages generative models and algorithms that support the generation of new content in the form of images, text, audio, and other multimedia. They utilize GPTs, GANs, VAEs, and other deep learning architectures to craft systems capable of generating data. May work with data scientists, machine learning engineers, and software developers.
$135,571 / year median in Massachusetts
Job Description
Software Engineer in Test at Global Applications Solution Software Engineer in Test at Global Applications Solution in Natick, Massachusetts Posted in about 13 hours ago.
Type:
full-time
Job Title:
Software Development Engineer in Test (SDET) -
Conversational AI Location:
Hartford, CT or Wellesley, MA (100% Onsite)
Duration:
12-Month Contract (Potential Extension)
Work Authorization:
Green Card or U.S.
Citizen Experience:
10+ Years Preferred Position Overview We are seeking a Senior Software Development Engineer in Test (SDET) to design and build robust test infrastructure for a high-volume Conversational AI platform. This is a developer-centric quality engineering role focused on building reusable test harnesses, automation frameworks, and AI evaluation systems-not traditional manual QA. You will empower engineering teams to own quality across voice, chat, and LLM-driven workflows.
Key Responsibilities Framework & Infrastructure:
Architect, build, and maintain reusable test frameworks and harnesses for Java/Node.js backend services, REST APIs, and frontends. Conversational
AI & LLM
Testing:
Design test strategies for multi-turn conversations, intent recognition, context handling, and orchestration logic. Apply modern evaluation methods like LLM-as-a-Judge.
Developer Enablement:
Provide testing patterns, documentation, and tools that allow developers to write automated tests seamlessly and own product quality.
Automation & Execution:
Automate Voice and Chat channels using modern tooling, integrate tests into GitHub Actions CI/CD pipelines, and establish test data strategies.
Quality Advocacy:
Partner with Architecture, Engineering, and Product teams to eliminate testing gaps, mentor engineers, and promote Test-Driven Development (TDD).
Required Qualifications Core Experience:
5+ years in software engineering with 3+ years specifically focused on SDET, framework design, and test infrastructure.
Development Skills:
Strong hands-on programming experience in Java or Node.js/JavaScript , alongside deep knowledge of Object-Oriented Design.
API & UI
Testing:
Advanced skills in
REST API
automation, contract testing, and tools like Playwright, Selenium, Jest, JUnit, Postman, Bruno, or Cucumber. Conversational AI / Voice /
Chat:
Hands-on experience automating tests for chatbots, voice bots, NLP systems, context/intent recognition, or AI agents.
AI Evaluation:
Exposure to AI/LLM testing methodologies (e.g., response accuracy validation, LLM-as-a-Judge).
CI/CD & Onsite Availability:
Experience integrating test suites into CI/CD (GitHub Actions) and ability to work fully onsite in Hartford, CT or Wellesley, MA . Preferred Qualifications Experience with specialized voice/chat testing tools like Cyara or Hammer . Proven track record designing enterprise-wide test infrastructure used by multiple teams. Hands-on experience testing autonomous AI agents, agentic workflows, or cloud-native architectures. Background in performance, load, and scalability testing. Chandan Singh +1 201-499-7364 chandan.s@globalapplications.com