Senior QA Engineer, Forward Deployed

About the Team

------------------

The Forward Deployed Team is our primary customer-facing unit, acting as the crucial bridge between our core product and our enterprise clients. This fast-moving team manages the end-to-end lifecycle of enterprise conversational AI deployments, from pre-sales Statements of Work (SOWs) through go-live.

We maintain daily, high-touch interactions with customers to communicate workflow progress, manage User Acceptance Testing (UAT) deadlines, integrate client feedback, and ensure that deployments are executed rapidly while maintaining rigorous quality standards.

Ellipsis Health is located in the San Francisco Bay Area, but we are open to remote candidates within the United States.

About the Role

------------------

As a Forward Deployed QA Engineer, you will occupy a critical, high-impact role dedicated to ensuring the reliability, stability, and quality of our core conversational AI product, Sage, across diverse client workflows.

This role bridges the gap between Quality Assurance, AI Engineering, and Production Operations. You will focus heavily on automated testing, prompt engineering validation, and rapid root cause analysis (RCA) of Large Language Model (LLM)-driven behaviors in fast-paced, real-world deployments.

Responsibilities

---------------------

• Workflow Mapping & Test Case Generation: Deeply analyze assigned client workflows to design robust, comprehensive positive and negative test cases that safeguard system stability.
• AI-Driven Test Automation: Build and execute automated test scenarios by configuring shadow agents.
• Prompt Evaluation & Optimization: Apply a strong understanding of prompt awareness to draft, refine, and evaluate prompts used within the testing framework to accurately simulate user behaviors and edge cases.
• End-to-End Testing Execution: Strategically deploy specific testing methodologies including Sanity, Smoke, Regression, and Functional testing - determin...