QA Engineer

Title: QA Engineer

Reporting to:

Director, QA Engineering

Location:

Bengaluru (Bangalore)

Opportunity

We are seeking a skilled

AI QA Engineer

with 4–6 years of experience in test automation and a strong focus on validating AI/ML and LLM-based systems. The ideal candidate will have hands-on expertise in automation frameworks, API/UI testing, and experience in validating NLP/LLM models across complex, data-driven applications.

Key Responsibilities

• Design, develop, and maintain scalable automation frameworks for UI, API, and backend systems
• Perform end-to-end testing of AI/ML pipelines, including NLP and LLM-based applications
• Validate LLM outputs using techniques such as prompt validation, response scoring, and model comparison
• Build and execute test strategies for microservices and event-driven architectures
• Conduct data validation across systems using SQL/BigQuery and ensure data accuracy in pipelines
• Automate regression, smoke, and end-to-end test suites to improve coverage and efficiency
• Integrate automated tests into CI/CD pipelines using Jenkins or similar tools
• Collaborate with developers, data scientists, and product teams to ensure high-quality AI solutions
• Analyze defects, identify root causes, and ensure timely resolution
• Continuously improve test frameworks, tools, and processes

Required Skills \& Qualifications

Automation \& Testing

• Strong experience in Selenium WebDriver, RestAssured, TestNG
• Expertise in API Testing, UI Testing, and Microservices Testing
• Experience in building Hybrid/POM-based automation frameworks

Programming

• Proficiency in Java (mandatory)
• Basic working knowledge of Python

AI / ML / LLM Testing

• Experience testing NLP/LLM models (e.g., BERT, GPT-based models, QWEN, Gemini)
• Knowledge of NER validation, prompt testing, and output evaluation techniques
• Exposure to model validation, scoring mechanisms, and dataset validation

Data \& Cloud

• Strong SQL skills with experience in BigQuery or similar platforms
• Understanding of event-driven systems (Pub/Sub or similar)
• Experience in validating JSON-based data pipelines

DevOps \& Tools

• Experience with Jenkins, Maven, Git/Bitbucket
• Knowledge of CI/CD pipeline integration and test reporting (Allure or similar)

Good to Have

• Experience in Healthcare, OTT, or E-commerce domains
• Exposure to EMR/EHR systems or clinical data validation
• Knowledge of UMLS, CUI mapping, or healthcare NLP concepts
• Experience with mobile testing (Appium)

Experience

• 4–6 years of experience in QA Automation / SDET roles
• Hands-on experience in AI/ML or LLM validation is highly preferred

Education

• Bachelor’s degree in Engineering, Computer Science, or related field

About Get Well

Now part of the SAI Group family, Get Well is redefining digital patient engagement by putting patients in control of their personalized healthcare journeys, both inside and outside the hospital. Get Well is combining high-tech AI navigation with high-touch care experiences driving patient activation, loyalty, and outcomes while reducing the cost of care. For almost 25 years, Get Well has served more than 10 million patients per year across over 1,000 hospitals and clinical partner sites, working to use longitudinal data analytics to better serve patients and clinicians. AI innovator SAI Group led by Chairman Romesh Wadhwani is the lead growth investor in Get Well. Get Well’s award-winning solutions were recognized again in 2024 by KLAS Research and AVIA Marketplace. Learn more at Get Well and follow-us on LinkedIn and Twitter.

Get Well is proud to be an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, gender, gender identity or expression, sexual orientation, national origin, genetics, disability, age or veteran status.

About SAI Group

• SAIGroup commits to $1 Billion capital, an advanced AI platform that currently processes 300M\+ patients, and 4000\+ global employee base to solve enterprise AI and high priority healthcare problems. SAIGroup - Growing companies with advanced AI; https://www.cnbc.com/2023/12/08/75-year-old-tech-mogul-betting-1-billion-of-his-fortune-on-ai-future.html
• Bio of our Chairman Dr. Romesh Wadhwani: Team - SAIGroup (Informal at Romesh Wadhwani - Wikipedia)
• TIME Magazine recently recognized Chairman Romesh Wadhwani as one of the Top 100 AI leaders in the world - Romesh and Sunil Wadhwani: The 100 Most Influential People in AI 2023 \| TIME