Lightnews — Scholar-powered news

IDI @institutional.org · 20d

Join us tomorrow at 10AM EST:
tinyurl.com/y3ye6cz6

IDI @institutional.org · 29d

Register to join the talk virtually: harvard.zoom.us/meeting/regi...

Welcome! You are invited to join a meeting: IDI Talk with Michele Dolfi & Peter Staar on SmolDocling. After registering, you will receive a confirmation email about joining the meeting.

Please join us for a talk with Michele Dolfi & Peter Staar from IBM Research in Zurich to discuss their work on SmolDocling, an “ultra-compact” model for diverse OCR tasks.

harvard.zoom.us

IDI @institutional.org · 29d

Can a small visual language model read documents as effectively as models 27 times its size?

Next Friday, IDI will host Michele Dolfi and Peter Staar from IBM Research Zurich to discuss their work on SmolDocling, an “ultra-compact” model for diverse OCR tasks.

1

Reposted by IDI

Greg Leppert @leppert.me · Jun 20

This Monday, @institutionaldatainitiative.org will host Petr Knoth to share his experience leading CORE ("The world’s largest collection of open access research papers") as the rise of AI brings new meaning, and challenges, to stewarding knowledge repositories. Join us virtually via the link below.

2 2 3

Reposted by IDI

Greg Leppert @leppert.me · Jun 16

Cohosted by @institutionaldatainitiative.org and The Berkman Klein Center. harvard.zoom.us/webinar/regi...

Welcome! You are invited to join a webinar: Open AI Development. After registering, you will receive a confirmation email about joining the webinar.

For AI to truly benefit society, it must be built on foundations of transparency, fairness, and accountability—starting with the most foundational building block that powers it: data. Not long ago, ...

harvard.zoom.us

1

IDI @institutional.org · Jun 12

We hope Institutional Books will be the beginning of a process that makes millions more books accessible to the public for a variety of uses.

We welcome feedback as we continue to expand this dataset, refine its contents, and sharpen our process.
www.institutionaldatainitiative.org/institutiona...

Institutional Books | Institutional Data Initiative

Institutional Books 1.0 is our first release of public domain books. This set was originally digitized through Harvard Library’s participation in the Google Books project..

www.institutionaldatainitiative.org

1 9

IDI @institutional.org · Jun 12

We look forward to growing Institutional Books through community. We welcome collaboration from researchers and model makers as we:
- Evaluate the dataset’s impact on model outputs
- Continuing to refine our OCR pipelines

View the dataset on Hugging Face: huggingface.co/datasets/ins...

institutional/institutional-books-1.0 · Datasets at Hugging Face

We’re on a journey to advance and democratize artificial intelligence through open source and open science.

huggingface.co

1 2 16

IDI @institutional.org · Jun 12

As part of our refinement work, we supplemented the original OCR-extracted text with a post-processed version that utilizes line detection to reassemble the text according to the line type.

1 2

IDI @institutional.org · Jun 12

We included extensive volume-level metadata with both original and generated components, such as results from text-level language detection.

1 3

IDI @institutional.org · Jun 12

We analyzed the dataset’s coverage across time, topic, and language and found:
- 40% of English text + long tail of 254 languages
- 20 clear topical tranches
- Largely published in the 19th and 20th centuries

Technical report here: arxiv.org/abs/2506.08300

2 1 8

IDI @institutional.org · Jun 12

Today we released Institutional Books 1.0, a 242B token dataset from Harvard Library's collections, refined for accuracy and usability. 🧵

9 29 75

Reposted by IDI

Greg Leppert @leppert.me · Apr 14

The @institutionaldatainitiative.org is proud to support The New Commons challenge. $100k grants along with mentorship. Let's get impactful data into the AI ecosystem.

The GovLab @thegovlab.org · Apr 14

(1/4) CALL FOR APPLICATIONS FOR DATA COMMONS FOR AI

🏆Today, The Open Data Policy Lab (a collaboration btwn The GovLab & @microsoft.com launched The New Commons Challenge—an innovation challenge to foster the creation of data commons that can support generative AI developed in the public interest.

5 7

Reposted by IDI

Greg Leppert @leppert.me · Mar 12

As the @institutionaldatainitiative.org expands its mission, we’re announcing a collaboration with @bpl.boston.gov to develop AI-driven tools capable of accelerating new digitization at libraries across the world, starting at the Boston Public Library. institutionaldatainitiative.org/posts/using-...

Using AI to Accelerate Digitization at Boston Public Librarys

Today, as part of our mission expansion, we’re announcing a collaboration with BPL to develop AI-driven tools capable of accelerating new digitization of large collections at libraries across the worl...

institutionaldatainitiative.org

1 10 18

Reposted by IDI

Greg Leppert @leppert.me · Mar 5

I'm pleased to announce we're expanding our mission at the @institutionaldatainitiative.org with an open call for institutional collaborators, new digitization at Harvard Law School Library, and additional support to advance this work. institutionaldatainitiative.org/posts/open-c...

Expanding Our Mission: An Open Call for Collaborators

Today, we’re pleased to announce an open call for institutional collaborators as new support expands the research capacity of the Institutional Data Initiative.

institutionaldatainitiative.org

1 9 11

IDI @institutional.org · Dec 13

Hello world. institutionaldatainitiative.org/hello-world....

How Knowledge Institutions Can Build a Promethean Moment

Why we’re launching the Institutional Data Initiative to work with libraries, government agencies, and other knowledge institutions to develop data collections and best practices for artificial intell...

institutionaldatainitiative.org

3 7