AI Tester C2C jobs at Tampa, FL

Contract

C2C roles

AI Tester

Location: Tampa, FL

Rate: $46/hr on c2c

** NON-LOCAL CANDIDATES WILL NOT BE REVIEWED **

 

 

Job Summary:

As a Functional Tester specializing in AI Agents, you will be responsible for designing, executing, and maintaining test cases that validate the functionality, reliability, and performance of AI-driven agent systems.

You will work closely with development teams, AI specialists, and product owners to ensure that AI agents perform accurately and efficiently in real-world scenarios.

 

Key Responsibilities:

• AI/LLM-Specific QA: Designing test frameworks for LLM outputs (hallucination checks, factuality tests,

toxicity/bias detection).

• Automation Frameworks: PyTest, Robot Framework, Playwright, Cypress, or custom LLM test harnesses.

• Evaluation Metrics: BLEU, ROUGE, BERTScore, GPT-based evaluators, human-in-the-loop validation.

• Data QA: Ensuring high-quality training/evaluation datasets, data validation (Great Expectations, Deequ).

• Python Automation: Scripting test cases, API test automation.

• CI/CD Integration: Automated test pipelines in Jenkins/GitHub Actions/GitLab CI.

• Performance Testing: Latency, throughput, stress testing of LLM-powered services.

• Leadership (Manager Level): Define QA strategies for AI systems, lead test automation teams, enforce quality gates.

To apply for this job email your details to bhargavi1@galaxyitech.com