Methods

Reference Extraction at the Intersection of AI Research and the Digital Humanities: Validation, Interoperability and Collaboration [Nov 4, hybrid]

Reference Extraction at the Intersection of AI Research and the Digital Humanities: Validation, Interoperability and Collaboration

This informal meeting is meant mainly to foster collaboration and knowledge exchange between researchers and practitioners working at the intersection of data extraction, artificial intelligence, and the digital humanities. In the workshop, we continue to address the challenge of extracting heterogeneous references from texts, particularly from historical documents and humanities or legal scholarship. This second workshop focuses on three key themes emerging from the 2023 discussions:

  1. Validation: How can we evaluate and benchmark the performance of different reference extraction tools and approaches, particularly with large language models?
  2. Interoperability: How can we ensure that different tools, datasets, and workflows can work together effectively through shared data models and formats?
  3. Collaboration: How can researchers, developers, and institutions work together to advance the field of reference extraction?

The program is available online at: https://mpilhlt.github.io/reference-extraction/workshop-2025/programme/

The event will take place in-person and online. Register at https://plan.events.mpg.de/e/refextract25 

A link for online attendance will be sent to registered participants before the event. Also, even if you cannot attend, but want to be informed about updates, materials being made available, etc. you can notify us about this at the registration link.

Programme

Tuesday 04 November 2025

Onboarding

09:00-09:15 Arrival/Registration

09:15-09:45 Christian Boulanger/Andreas Wagner (mpilhlt): Welcome and Upshot from RefExtract2023, State of the Discussion

09:45-10:00 Coffee Break

Research presentations

10:00-12:30

  1. Hiba Arnaout (TU Darmstadt): In-depth Research Impact Summarization through Fine-Grained Temporal Citation Analysis
  2. Yurui Zhu/Matteo Romanello (Odoma): Benchmarking Large Language Models on Reference Extraction and Parsing in the Social Sciences and Humanities
  3. Sofía Aguilar Valdez (Saarland University): How Scientific Ideas Evolve
  4. Open Discussion and Ad-Hoc Presentation of Research

12:30-13:30 Lunch

Datasets, Infrastructure and Interoperability

13:30-15:30

  1. Angelo Di Iorio/Matteo Guenci/Marta Soricetti*/Silvio Peroni/Lorenzo Paolini*/Ivan Heibi (University of Bologna): Citation Extractor and Classifier: Pipeline and Datasets (*presenting)
  2. Tamara Heck/Christoph Schindler/Verena Weimer/Philipp Mayr/Ahsan Shahid (DIPF/GESIS): Open Citation Data for Educational Research
  3. Christian Boulanger, Andreas Wagner (mpilhlt): Datasets in the Legal Theory Knowledge Graph Project
  4. Interoperability Roundtable: Open Discussion on Data Models and Data Formats

15:30-16:00 Coffee Break

Tools, Workflows and Pipelines

16:00-17:30

  1. Raphael Schlattmann/Malte Vogl (mpigea)/Aleksandra Kaye (TU Berlin/mpigea): LLM-Based Knowledge Graph Extraction Pipeline
  2. Luca Foppiano (ScienciaLAB): Training the Grobid Reference Extraction Models
  3. Christian Boulanger/Andreas Wagner (mpilhlt): Annotation Tools for Machine Learning: PDF-TEI Editor (for LLamore & Grobid), Prodigy, TEI-Publisher

17:30-18:30 Takeaways, Way Forward, Closing