Follow AES events

Get involved

Join or work with AES

AES brings together researchers and practitioners to improve how AI agents are evaluated. There are many ways to get involved, from joining the research community to contributing expertise, resources, or support.

For individuals

Join AES

We are building a network of researchers and practitioners interested in making agent evaluation more scientific, useful, and reliable.

Join a working group

You can bring a research question, propose or join a project, contribute to a working group, mentor other researchers, help organize a local community, or contribute to the Evaluation Commons.

Explore working groups and events →
Propose or join a project

Bring a research question or project to the AES network. AES can help connect project leads with collaborators, mentors, domain experts, and available resources. Researchers who lead projects retain project leadership and authorship.

Mentor or contribute

Researchers and practitioners can also participate without joining the core team, including as mentors, instructors, reviewers, research associates, or local organizers. These roles can range from a single project or event to ongoing involvement.

Join the core team

We are currently building a small core team with substantial ownership over AES.

Operations & Community Lead

Run day-to-day operations, working groups, symposia, and course operations. Coordinate participants, partnerships, local organizers, funding applications, and follow-up.

Research & Network Lead

Lead the research agenda and project-matching network. Recruit mentors, track projects, maintain the Evaluation Commons, and support research toward public outputs.

Both roles will work closely with the Founder / Executive Director and help shape AES’s direction.

For organizations

Work with AES

We work with research groups, companies, funders, and other organizations interested in improving how AI agents are evaluated.

Research collaboration

Bring a research question or project to the AES network. AES can help connect project leads with collaborators, mentors, domain experts, and available resources. Researchers who lead projects retain project leadership and authorship.

Funding and partnerships

Organizations with funding or expertise can support evaluation research across the AES network.

Independent evaluation and evidence review

AES provides independent review and guidance for organizations seeking an external assessment of evaluation methods or claims.

For each review, AES will assemble a small group of researchers and practitioners from its network with relevant expertise and no direct involvement in the work being assessed. The group will review the materials and produce a concise written assessment of what the evidence supports and what could be improved.

These reviews will generally be offered as a paid service, with reduced-cost or pro bono support available for selected academic and public-interest projects when resources allow.

Community partnership (events and working groups)

Universities, research groups, companies, and other organizations can work with AES to host working groups and events, connect local researchers, or contribute to the broader evaluation community.

Collaboration

Current collaborators & partners

AES works with researchers, research groups, and organizations across academia, industry, and the public sector. These collaborations inform our research, events, and community programs.

Raycaster
Research partner

Raycaster

Expert-generated cases and domain data for consequential AI workflows.

How we work together

Exploring how proprietary case corpora and domain expertise can support rigorous benchmark research and development.

Vector Institute
Community partner

Vector Institute

Independent research and community collaboration on AI evaluation.

How we work together

Sharing research and connecting evaluation work across the agent evaluation community.

Community partner

Digital Health and Patient Safety Platform (DHPSP)

An open research and collaboration network for digital health and patient safety.

How we work together

Connecting researchers and sharing ideas, research, and opportunities across agent evaluation, digital health, and patient safety.

Contact

Interested in collaborating or supporting AES?

We welcome research collaborations, resource contributions, partnerships, and other forms of support.

Send your message directly to the AES team.

Or email contact@evalscience.org