Fall 2026 · New York City

Call for Presentations

Short papers and extended abstracts on the science and practice of AI agent evaluation.

Submission options

Choose your submission

Short paper

Archival or presentation-only
Length
Up to 6 pages, excluding references
Best for
Completed research and evaluation studies

Extended abstract

Presentation-only
Length
Up to 2 pages, excluding references
Best for
Ongoing or published work, tools, demonstrations, datasets, failures, and industry cases

Presentation preference

  • Oral preferred
  • Poster preferred
  • Either

Final format is determined by the program committee.

Scope

What we are looking for

01

Diagnose

Audits, replications, negative results, contamination, grader instability, and evaluation gaps.

02

Measure

Constructs, metrics, rubrics, human evaluation, automated graders, reliability, validity, cost, and safety.

03

Operationalize

Benchmarks, environments, harnesses, traces, repeated runs, versioning, observability, and scalable grading.

04

Apply

Coding, research, science, healthcare, enterprise, web, computer-use, multimodal, and other tool-using agents.

Selection

How submissions are evaluated

  1. 01A clear evaluation target and appropriately bounded claims
  2. 02Relevant evidence supported by sound methods and reporting
  3. 03A useful lesson for evaluation research or practice
  4. 04Strong symposium fit and value to scientific discussion

Industry and real-world submissions are assessed on concrete evidence, production lessons, and generalizable insight. A new benchmark or algorithm is not required.

Author information

Submission requirements

Formatting
Use the EasyChair/EPiC template for both submission types. The same page size, fonts, title and author formatting, and citation style apply. Page limits exclude references.
OpenReview selections
Select Short Paper or Extended Abstract and a presentation preference. Short-paper authors also select archival or presentation-only; extended abstracts are presentation-only.
Attendance
At least one author of every accepted contribution must register and present.
Review
Submissions are reviewed through OpenReview. Short papers normally receive three independent reviews.
Review materials
Anonymity and supplementary-material instructions will be confirmed when the call opens. Supplementary material does not change the page limit.
Prior publication
Archival work must be original, unpublished, and not under simultaneous archival review. Presentation-only work may be ongoing or previously published, with prior publications identified and cited.

Final publication and licensing terms will be confirmed before camera-ready submission. There is no long-paper track.

FAQ

Common questions

Can I submit published work?

Yes, as a presentation-only short paper or extended abstract. Identify and cite the prior publication. Published work is not eligible for archival proceedings.

Can I present remotely?

The meeting is primarily in person in New York City. Limited remote presentation may be approved when necessary.

Which submissions appear in the proceedings?

Only accepted archival short papers. Presentation-only short papers and all extended abstracts are non-archival.

Who decides whether I give an oral or poster?

Authors indicate Oral preferred, Poster preferred, or Either. The program committee makes the final assignment.

Questions about the call?contact@evalscience.org