UAEF

UAEF is a framework for scoring AI agent quality across tool use, answer quality, safety, speed, and reasoning for developers testing agents.

What it is good for

  • Measuring how well an AI agent calls tools and answers questions
  • Comparing agent experiments against baselines to catch regressions
  • Checking agent outputs for safety issues and hallucinations
  • Tracking agent performance and cost across repeated test runs

At a glance

Who it is for
Setup difficulty
Developer ยท Requires programming

Level 5 of 5. You need to write code to use it.

Cost
Free and open source
Type
Framework or SDK
Tasks
Works with
LangGraph, LangChain, AWS Bedrock, Langfuse, Strands, AgentCore

Momentum

Rank this week
Not ranked yet
Best rank
None yet
GitHub stars
144

GitHub numbers as of Nov 16, 2026. Updated weekly.

86 117 148 Nov 13, 2026 Nov 16, 2026
GitHub stars for UAEF: 90 on Nov 13, 2026, 144 on Nov 16, 2026. Source: GitHub.

Questions

Is UAEF free?
Yes. It is free and open source (Apache-2.0 license).
Do I need to know how to code to use UAEF?
Yes. You need to write code to use it.
What does UAEF work with?
According to its own documentation, it works with LangGraph, LangChain, AWS Bedrock, Langfuse, Strands, and AgentCore.
What is UAEF good for?
Measuring how well an AI agent calls tools and answers questions, comparing agent experiments against baselines to catch regressions, checking agent outputs for safety issues and hallucinations, and tracking agent performance and cost across repeated test runs.

Similar agents to UAEF

  • GEPA

    GEPA is a framework that improves prompts, code, and agent settings by testing and rewriting them automatically for developers.

  • AssetOpsBench

    AssetOpsBench is a framework and benchmark for building and testing AI agents that handle industrial equipment maintenance for researchers and engineers.

  • exxperts

    exxperts is a desktop app that keeps a reviewable memory for each project so AI answers build on what you confirmed.

  • AgentDescent

    AgentDescent is a Python framework that improves prompts, skills, and agent setups by testing them against your own examples for developers and builders.

  • caveman

    Caveman is a skill and proxy that cuts token use by making coding agents answer tersely and shrink the text they read, for developers and heavy AI users.

  • career-ops

    Career-ops is an open-source job search agent that scores job listings against your CV and drafts tailored applications for you to review and submit.

Last updated Nov 16, 2026. Tracked since Nov 13, 2026. Spotted an error? Tell us.