Fall 2026 · New York City

Call for Presentations

Short papers and extended abstracts on the science and practice of AI agent evaluation.

Submission options

Choose your submission

Short paper

Presentation-only
Length
4–6 pages, excluding references
Best for
Completed studies, substantial tools or datasets, and detailed empirical analyses

Extended abstract

Presentation-only
Length
2 pages, excluding references
Best for
Ongoing or published work, tools, demonstrations, datasets, failures, and industry cases

Presentation preference

  • Oral preferred
  • Poster preferred
  • Either

Final format is determined by the program committee.

Scope

What we are looking for

01

Diagnose

Audits, replications, negative results, contamination, grader instability, and evaluation gaps.

02

Measure

Constructs, metrics, rubrics, human evaluation, automated graders, reliability, validity, cost, and safety.

03

Operationalize

Benchmarks, environments, harnesses, traces, repeated runs, versioning, observability, and scalable grading.

04

Apply

Coding, research, science, healthcare, enterprise, web, computer-use, multimodal, and other tool-using agents.

Selection

How submissions are evaluated

  1. 01A clear evaluation target and appropriately bounded claims
  2. 02Relevant evidence supported by sound methods and reporting
  3. 03Findings relevant to evaluation research or practice
  4. 04Relevance to the symposium scope and scientific discussion

Industry and real-world submissions are assessed on documented evidence, production lessons, and findings relevant beyond a single system or setting. A new benchmark or algorithm is not required.

Recognition

Spotlight selections and Best Paper

01

Five Spotlight Papers & Abstracts

Five accepted contributions, including short papers and extended abstracts, will be recognized as Spotlight selections.

02

One Best Paper Award

One accepted short paper will receive the Best Paper Award for an especially rigorous, clear, and meaningful contribution to agent evaluation.

Agent Evaluation Science Fall 2026

Certificate of Recognition

Best Paper AwardIssued by Agent Evaluation Science for this symposium

Committee members will select the Spotlight contributions and Best Paper from accepted submissions, considering rigor, clarity, relevance, and potential to advance evaluation science. The Best Paper awardee will receive the AES Certificate of Recognition.

Author information

Submission requirements

Submission system
Submit a single PDF through OpenReview. OpenReview is the only submission system for this symposium.
Formatting
Use the AES LaTeX Template to prepare your submission. Submit a readable PDF with a title, author names and affiliations, and references. Page limits exclude references. Appendices are allowed and do not count toward the page limit.
OpenReview selections
Select Short Paper or Extended Abstract and a presentation preference.
Attendance
At least one author of every accepted contribution must register and present.
Review
Submissions are reviewed through an open-review process on OpenReview. Reviews and decisions are managed in the OpenReview venue.
Author identity
Submissions are not anonymous. Include author names and affiliations in the manuscript and OpenReview record.
Prior publication
Ongoing work, previously published work, tools, datasets, negative results, failure analyses, and real-world cases are all eligible. Identify and cite any prior publication.

Travel support

Support for presenting authors

A limited travel-support fund is available for presenting authors. Remote presentation is also available.

Apply for Travel Support

FAQ

Common questions

Can I submit published work?

Yes. Published work, ongoing work, tools, datasets, negative results, and failure analyses are eligible. Identify and cite any prior publication.

Are submissions archival?

No. Both short papers and extended abstracts are presentation-only and non-archival. Authors may submit work currently under review or previously published, subject to the policies of the other venue.

Can I present remotely?

The symposium is primarily in person. Remote presentation is available for accepted authors who cannot reasonably attend in person, including authors based outside the United States. Authors may present either an oral presentation or poster remotely if assigned that format.

Who decides whether I give an oral or poster?

Authors indicate Oral preferred, Poster preferred, or Either. The program committee makes the final assignment.

Questions about the call?contact@evalscience.org