![Reference Extraction at the Intersection of AI Research and the Digital Humanities: Validation, Interoperability and Collaboration [Nov 4, hybrid]](https://dariah.ie/wordpress/wp-content/uploads/2025/08/cropped-cropped-Picture-1-scaled-1.png)
Reference Extraction at the Intersection of AI Research and the Digital Humanities: Validation, Interoperability and Collaboration [Nov 4, hybrid]
Reference Extraction at the Intersection of AI Research and the Digital Humanities: Validation, Interoperability and Collaboration
This informal meeting is meant mainly to foster collaboration and knowledge exchange between researchers and practitioners working at the intersection of data extraction, artificial intelligence, and the digital humanities. In the workshop, we continue to address the challenge of extracting heterogeneous references from texts, particularly from historical documents and humanities or legal scholarship. This second workshop focuses on three key themes emerging from the 2023 discussions:
- Validation: How can we evaluate and benchmark the performance of different reference extraction tools and approaches, particularly with large language models?
- Interoperability: How can we ensure that different tools, datasets, and workflows can work together effectively through shared data models and formats?
- Collaboration: How can researchers, developers, and institutions work together to advance the field of reference extraction?
The program is available online at: https://mpilhlt.github.io/reference-extraction/workshop-2025/programme/
The event will take place in-person and online. Register at https://plan.events.mpg.de/e/refextract25
A link for online attendance will be sent to registered participants before the event. Also, even if you cannot attend, but want to be informed about updates, materials being made available, etc. you can notify us about this at the registration link.
Programme
Tuesday 04 November 2025
Onboarding
09:00-09:15 Arrival/Registration
09:15-09:45 Christian Boulanger/Andreas Wagner (mpilhlt): Welcome and Upshot from RefExtract2023, State of the Discussion
09:45-10:00 Coffee Break
Research presentations
10:00-12:30
- Hiba Arnaout (TU Darmstadt): In-depth Research Impact Summarization through Fine-Grained Temporal Citation Analysis
- Yurui Zhu/Matteo Romanello (Odoma): Benchmarking Large Language Models on Reference Extraction and Parsing in the Social Sciences and Humanities
- Sofía Aguilar Valdez (Saarland University): How Scientific Ideas Evolve
- Open Discussion and Ad-Hoc Presentation of Research
12:30-13:30 Lunch
Datasets, Infrastructure and Interoperability
13:30-15:30
- Angelo Di Iorio/Matteo Guenci/Marta Soricetti*/Silvio Peroni/Lorenzo Paolini*/Ivan Heibi (University of Bologna): Citation Extractor and Classifier: Pipeline and Datasets (*presenting)
- Tamara Heck/Christoph Schindler/Verena Weimer/Philipp Mayr/Ahsan Shahid (DIPF/GESIS): Open Citation Data for Educational Research
- Christian Boulanger, Andreas Wagner (mpilhlt): Datasets in the Legal Theory Knowledge Graph Project
- Interoperability Roundtable: Open Discussion on Data Models and Data Formats
15:30-16:00 Coffee Break
Tools, Workflows and Pipelines
16:00-17:30
- Raphael Schlattmann/Malte Vogl (mpigea)/Aleksandra Kaye (TU Berlin/mpigea): LLM-Based Knowledge Graph Extraction Pipeline
- Luca Foppiano (ScienciaLAB): Training the Grobid Reference Extraction Models
- Christian Boulanger/Andreas Wagner (mpilhlt): Annotation Tools for Machine Learning: PDF-TEI Editor (for LLamore & Grobid), Prodigy, TEI-Publisher
17:30-18:30 Takeaways, Way Forward, Closing
