Call for Tiny Papers

We are soliciting tiny papers (up to 2 pages long) in the following formats:

  1. Extended Abstracts: Short but complete research papers presenting original or interesting results around social impact evaluation for generative AI.
  2. “Provocations”: Novel perspectives or challenges to conventional wisdom around social impact evaluation for generative AI.

Themes for Submissions

We welcome submissions addressing, but not limited to, the following themes:

  • Conceptualization and operationalization issues in evaluations of:
    • Bias, stereotypes, and representational harms
    • Cultural values and sensitive content
    • Community-centered definitions of disparate performance and privacy
    • Documentation frameworks for financial and environmental costs of models
  • Ethical or consequential validity considerations for:
    • Data protection
    • Data and content moderation labor
    • Historical implications of evaluation data or practices for evaluation validity
  • Interrogating or critiquing the theoretical basis of existing evaluations

  • Novel methodologies for evaluating social impact across different AI modalities

  • Comparative analyses of existing evaluation frameworks and their effectiveness

  • Case studies of social impact evaluations in real-world AI applications

Submission Guidelines

  • Paper Length: Maximum 2 pages, excluding unlimited pages for references.
  • Format: PDF file, using the NeurIPS 2024 LaTeX style file
  • Submission Portal: OpenReview
  • Anonymity: Submissions should be anonymous for two-way anonymized review.
  • Archival: Papers, along with speaker slides for those who choose to opt in, will be archived and linked on the workshop website once available. However, there will be no formal proceedings or published records. Co-submission of a tiny paper that is also appearing as a longer version in the main conference is allowed.
  • This is a participatory, in-person event. Accepted Authors are encouraged to present their work and discuss it at the event.
  • Broader impact statement and Limitation section are not counted in the paper length.

Important Dates

  • Submission Deadline: September 20, 2024 AOE
  • Notification of Acceptance: October 9, 2024 AOE
  • Workshop Date: December 14 or 15, 2024 [TBD]