{"@context":"https://schema.org","@type":"JobPosting","directApply":"https://schema.org/False","title":"AI Test Engineer II","description":"At TREND Health Partners, a tech-enabled payment integrity company, our mission is to facilitate collaboration between payers and providers for mutual benefit and waste reduction, ultimately improving access to healthcare. We achieve this by aligning the common goals of payers and providers and fostering collaboration through a shared technology platform and seamless workflows.Joining TREND Health Partners means becoming a part of a dynamic growing organization that promotes a collaborative and innovative work environment. Our comprehensive compensation package includes competitive salaries, highly valued health insurance, a 401(k) plan with employer match, paid parental leave, and more.

The AI Test Engineer II's primary responsibility is validating the quality, reliability, and safety of AI powered systems across TREND's platform.

Role and Responsibilities

AI Testing & Validation
- Design and execute test strategies for AI/ML models, including functional, regression, and scenario-based testing
- Validate accuracy, consistency, and reliability of AI-generated outputs (e.g., summaries, classifications, recommendations)
- Develop test cases for edge cases, model drift, and unexpected behavior scenarios
- Evaluate model performance against defined success criteria and business requirements
Agent & Workflow Testing
- Test agent-driven workflows (multi-step AI processes, automation pipelines, orchestration logic)
- Validate interactions between AI agents, APIs, and downstream systems
- Identify failure points in end-to-end AI workflows and recommend improvements
Data Quality & Integrity
- Validate training, validation, and test datasets for completeness, accuracy, and bias risks
- Perform data validation testing across pipelines to ensure integrity of inputs and outputs
- Partner with Data Engineering to detect anomalies, inconsistencies, and gaps
Automation & Tooling
- Build and maintain automated test frameworks for AI-enabled systems
- Develop scripts and tools to support repeatable testing of AI outputs at scale
- Integrate testing into CI/CD pipelines to enable continuous validation
AI Risk & Guardrails
- Help define and validate guardrails for AI systems (accuracy thresholds, explainability, fallback logic)
- Identify risks related to hallucinations, bias, and model drift
- Partner with Engineering and AI teams to improve reliability and safety
Collaboration & Continuous Improvement
- Work cross-functionally with Engineering, QA, AI, Product, and Operations teams
- Participate in sprint planning, backlog refinement, and release validation
- Contribute to testing standards, best practices, and documentation
- Support root cause analysis for AI-related defects and production issues

Qualifications

Bachelor’s degree in Computer Science, Data Science, Engineering, or related field (or equivalent experience)
Experience in QA, testing, or a related engineering role
Experience testing APIs, data pipelines, or distributed systems
Strong understanding of software testing principles and test automation
Experience working in Agile development environment.
Familiarity with AI/ML concepts (model evaluation, training vs inference, prompt behavior, etc.)
Experience with test automation tools
Strong SQL/data validation skills
Experience working with cloud-based systems (AWS or Databricks preferred)
Ability to analyze system behavior and identify root causes

Preferred Skills

Experience testing AI/ML models or data-driven systems
Experience validating AI-generated outputs or prompt-based systems
Familiarity with LLMs, agent workflows, or AI-assisted coding tools
Healthcare or regulated data environment experience (HIPAA, compliance)
Experience working with CI/CD and DevOps pipelines.

Mental And Physical Demands

This position will be exposed mainly to an indoor office environment and will be expected to work in or around computers and printers.
The nature of the work is sedentary, and the employee will be sitting most of the time.
Essential physical functions of the job include typing and the repetitive motion to utilize computer software and hardware continuously throughout the day.
Essential mental functions of this position include concentrating on analytical tasks, reading information, and verbal/written communication to others continuously throughout the day.

Related Duties As Assigned

This job description documents the general nature and level of work but is not intended to be a comprehensive list of activities, duties, or responsibilities required for this position. Consequently, employee’s may be asked to perform other duties as required.
Employees may also be asked to complete certain compliance requirements set forth by our Business Partners in the performance of their jobs including but not limited to requests for background and drug screenings and disclosures of personal health information or personally identifiable information. Exemptions as provided under the ADA and TITLE VII of the Civil Rights Act will be observed and followed.
Reasonable accommodations may be made to enable individuals with disabilities to perform the functions outlined above.

","identifier":"https://remote.com/jobs/trend-health-partners-c1xexkgj/ai-test-engineer-ii-j12wjdrm","employmentType":"FULL_TIME","hiringOrganization":{"@type":"Organization","name":"Trend Health Partners","sameAs":"https://trendhealthpartners.com"},"datePosted":"2026-06-19T20:10:36Z","applicantLocationRequirements":[{"@type":"Country","name":"Albania"},{"@type":"Country","name":"Algeria"},{"@type":"Country","name":"American Samoa"},{"@type":"Country","name":"Andorra"},{"@type":"Country","name":"Angola"},{"@type":"Country","name":"Anguilla"},{"@type":"Country","name":"Antigua and Barbuda"},{"@type":"Country","name":"Argentina"},{"@type":"Country","name":"Armenia"},{"@type":"Country","name":"Aruba"},{"@type":"Country","name":"Australia"},{"@type":"Country","name":"Austria"},{"@type":"Country","name":"Azerbaijan"},{"@type":"Country","name":"Bahamas"},{"@type":"Country","name":"Bahrain"},{"@type":"Country","name":"Bangladesh"},{"@type":"Country","name":"Barbados"},{"@type":"Country","name":"Belgium"},{"@type":"Country","name":"Belize"},{"@type":"Country","name":"Benin"},{"@type":"Country","name":"Bermuda"},{"@type":"Country","name":"Bhutan"},{"@type":"Country","name":"Bolivia"},{"@type":"Country","name":"Bosnia and Herzegovina"},{"@type":"Country","name":"Botswana"},{"@type":"Country","name":"Brazil"},{"@type":"Country","name":"British Virgin Islands"},{"@type":"Country","name":"Brunei"},{"@type":"Country","name":"Bulgaria"},{"@type":"Country","name":"Burkina Faso"},{"@type":"Country","name":"Burundi"},{"@type":"Country","name":"Cabo Verde"},{"@type":"Country","name":"Cambodia"},{"@type":"Country","name":"Cameroon"},{"@type":"Country","name":"Canada"},{"@type":"Country","name":"Cayman Islands"},{"@type":"Country","name":"Central African Republic (CAR)"},{"@type":"Country","name":"Chad"},{"@type":"Country","name":"Chile"},{"@type":"Country","name":"China"},{"@type":"Country","name":"Christmas Island"},{"@type":"Country","name":"Cocos (Keeling) Islands"},{"@type":"Country","name":"Colombia"},{"@type":"Country","name":"Comoros"},{"@type":"Country","name":"Cook Islands"},{"@type":"Country","name":"Costa Rica"},{"@type":"Country","name":"Cote d'Ivoire"},{"@type":"Country","name":"Croatia"},{"@type":"Country","name":"Curacao"},{"@type":"Country","name":"Cyprus"},{"@type":"Country","name":"Czech Republic"},{"@type":"Country","name":"Democratic Republic of the Congo"},{"@type":"Country","name":"Denmark"},{"@type":"Country","name":"Djibouti"},{"@type":"Country","name":"Dominica"},{"@type":"Country","name":"Dominican Republic"},{"@type":"Country","name":"Ecuador"},{"@type":"Country","name":"Egypt"},{"@type":"Country","name":"El Salvador"},{"@type":"Country","name":"Equatorial Guinea"},{"@type":"Country","name":"Eritrea"},{"@type":"Country","name":"Estonia"},{"@type":"Country","name":"Ethiopia"},{"@type":"Country","name":"Falkland Islands (Malvinas)"},{"@type":"Country","name":"Faroe Islands"},{"@type":"Country","name":"Fiji"},{"@type":"Country","name":"Finland"},{"@type":"Country","name":"France"},{"@type":"Country","name":"French Guiana"},{"@type":"Country","name":"French Polynesia"},{"@type":"Country","name":"Gabon"},{"@type":"Country","name":"Gambia"},{"@type":"Country","name":"Georgia"},{"@type":"Country","name":"Germany"},{"@type":"Country","name":"Ghana"},{"@type":"Country","name":"Gibraltar"},{"@type":"Country","name":"Greece"},{"@type":"Country","name":"Greenland"},{"@type":"Country","name":"Grenada"},{"@type":"Country","name":"Guadeloupe"},{"@type":"Country","name":"Guam"},{"@type":"Country","name":"Guatemala"},{"@type":"Country","name":"Guernsey"},{"@type":"Country","name":"Guinea"},{"@type":"Country","name":"Guinea-Bissau"},{"@type":"Country","name":"Guyana"},{"@type":"Country","name":"Haiti"},{"@type":"Country","name":"Honduras"},{"@type":"Country","name":"Hong Kong"},{"@type":"Country","name":"Hungary"},{"@type":"Country","name":"Iceland"},{"@type":"Country","name":"India"},{"@type":"Country","name":"Indonesia"},{"@type":"Country","name":"Ireland"},{"@type":"Country","name":"Isle of Man"},{"@type":"Country","name":"Israel"},{"@type":"Country","name":"Italy"},{"@type":"Country","name":"Jamaica"},{"@type":"Country","name":"Japan"},{"@type":"Country","name":"Jersey"},{"@type":"Country","name":"Jordan"},{"@type":"Country","name":"Kazakhstan"},{"@type":"Country","name":"Kenya"},{"@type":"Country","name":"Kiribati"},{"@type":"Country","name":"Kosovo"},{"@type":"Country","name":"Kuwait"},{"@type":"Country","name":"Kyrgyzstan"},{"@type":"Country","name":"Laos"},{"@type":"Country","name":"Latvia"},{"@type":"Country","name":"Lebanon"},{"@type":"Country","name":"Lesotho"},{"@type":"Country","name":"Liberia"},{"@type":"Country","name":"Libya"},{"@type":"Country","name":"Liechtenstein"},{"@type":"Country","name":"Lithuania"},{"@type":"Country","name":"Luxembourg"},{"@type":"Country","name":"Macao"},{"@type":"Country","name":"Madagascar"},{"@type":"Country","name":"Malawi"},{"@type":"Country","name":"Malaysia"},{"@type":"Country","name":"Maldives"},{"@type":"Country","name":"Mali"},{"@type":"Country","name":"Malta"},{"@type":"Country","name":"Marshall Islands"},{"@type":"Country","name":"Martinique"},{"@type":"Country","name":"Mauritania"},{"@type":"Country","name":"Mauritius"},{"@type":"Country","name":"Mayotte"},{"@type":"Country","name":"Mexico"},{"@type":"Country","name":"Micronesia"},{"@type":"Country","name":"Moldova"},{"@type":"Country","name":"Monaco"},{"@type":"Country","name":"Mongolia"},{"@type":"Country","name":"Montenegro"},{"@type":"Country","name":"Montserrat"},{"@type":"Country","name":"Morocco"},{"@type":"Country","name":"Mozambique"},{"@type":"Country","name":"Namibia"},{"@type":"Country","name":"Nauru"},{"@type":"Country","name":"Nepal"},{"@type":"Country","name":"Netherlands"},{"@type":"Country","name":"New Caledonia"},{"@type":"Country","name":"New Zealand"},{"@type":"Country","name":"Nicaragua"},{"@type":"Country","name":"Niger"},{"@type":"Country","name":"Nigeria"},{"@type":"Country","name":"Niue"},{"@type":"Country","name":"Norfolk Island"},{"@type":"Country","name":"Northern Mariana Islands"},{"@type":"Country","name":"North Macedonia"},{"@type":"Country","name":"Norway"},{"@type":"Country","name":"Oman"},{"@type":"Country","name":"Pakistan"},{"@type":"Country","name":"Palau"},{"@type":"Country","name":"Palestine"},{"@type":"Country","name":"Panama"},{"@type":"Country","name":"Papua New Guinea"},{"@type":"Country","name":"Paraguay"},{"@type":"Country","name":"Peru"},{"@type":"Country","name":"Philippines"},{"@type":"Country","name":"Poland"},{"@type":"Country","name":"Portugal"},{"@type":"Country","name":"Puerto Rico"},{"@type":"Country","name":"Qatar"},{"@type":"Country","name":"Republic of the Congo"},{"@type":"Country","name":"Réunion"},{"@type":"Country","name":"Romania"},{"@type":"Country","name":"Rwanda"},{"@type":"Country","name":"Saint Helena"},{"@type":"Country","name":"Saint Kitts and Nevis"},{"@type":"Country","name":"Saint Lucia"},{"@type":"Country","name":"Saint Pierre and Miquelon"},{"@type":"Country","name":"Saint Vincent and the Grenadines"},{"@type":"Country","name":"Samoa"},{"@type":"Country","name":"San Marino"},{"@type":"Country","name":"Sao Tome and Principe"},{"@type":"Country","name":"Saudi Arabia"},{"@type":"Country","name":"Senegal"},{"@type":"Country","name":"Serbia"},{"@type":"Country","name":"Seychelles"},{"@type":"Country","name":"Sierra Leone"},{"@type":"Country","name":"Singapore"},{"@type":"Country","name":"Slovakia"},{"@type":"Country","name":"Slovenia"},{"@type":"Country","name":"Solomon Islands"},{"@type":"Country","name":"Somalia"},{"@type":"Country","name":"South Africa"},{"@type":"Country","name":"South Korea"},{"@type":"Country","name":"South Sudan"},{"@type":"Country","name":"Spain"},{"@type":"Country","name":"Sri Lanka"},{"@type":"Country","name":"Sudan"},{"@type":"Country","name":"Suriname"},{"@type":"Country","name":"Swaziland"},{"@type":"Country","name":"Sweden"},{"@type":"Country","name":"Switzerland"},{"@type":"Country","name":"Taiwan"},{"@type":"Country","name":"Tajikistan"},{"@type":"Country","name":"Tanzania"},{"@type":"Country","name":"Thailand"},{"@type":"Country","name":"Timor-Leste"},{"@type":"Country","name":"Togo"},{"@type":"Country","name":"Tonga"},{"@type":"Country","name":"Trinidad and Tobago"},{"@type":"Country","name":"Tunisia"},{"@type":"Country","name":"Turkey"},{"@type":"Country","name":"Turkmenistan"},{"@type":"Country","name":"Turks and Caicos Islands"},{"@type":"Country","name":"Tuvalu"},{"@type":"Country","name":"Uganda"},{"@type":"Country","name":"Ukraine"},{"@type":"Country","name":"United Arab Emirates (UAE)"},{"@type":"Country","name":"United Kingdom (UK)"},{"@type":"Country","name":"United States"},{"@type":"Country","name":"Uruguay"},{"@type":"Country","name":"U.S. Virgin Islands"},{"@type":"Country","name":"Uzbekistan"},{"@type":"Country","name":"Vanuatu"},{"@type":"Country","name":"Vatican City (Holy See)"},{"@type":"Country","name":"Vietnam"},{"@type":"Country","name":"Wallis and Futuna Islands"},{"@type":"Country","name":"Yemen"},{"@type":"Country","name":"Zambia"},{"@type":"Country","name":"Zimbabwe"}],"jobLocationType":"TELECOMMUTE","baseSalary":{"@type":"MonetaryAmount","currency":"USD","value":{"@type":"QuantitativeValue","minValue":125000,"maxValue":150000,"unitText":"YEAR"}}}