Lightnews — Scholar-powered news

Human Rights Data Analysis Group @hrdag.org · 2d

We used LLMs to help shed light on millions of pages of documents about police abuses in California.

hrdag.substack.com/p/pulling-ba...

Black text on white background: we developed LLMs to bring structure to the unstructured: analyzing the content of the documents, organizing the information, and shedding light on what is buried within them." hrdag.substack.com

Human Rights Data Analysis Group @hrdag.org · 5d

Under California's Right to Know Act, police departments are supposed to provide records about police misconduct and use of force.

We used LLMs to help identify when the records they sent back were likely incomplete. hrdag.substack.com/p/pulling-ba...

White text on orange background: LLMs proved instrumental from the very beginning of this project, first by helping us identify when the documents we received were likely incomplete.

Pulling Back the Curtain on LLMs & Policing Data

Human Rights Data Analysis Group @hrdag.org · 5d

Thanks @demandprogress.bsky.social. Encryption is a necessity for human rights advocates.

Demand Progress @demandprogress.bsky.social · 6d

Encryption is a vital tool that protects us and safeguards our rights in a increasingly digital world. Learn more from our friends at @hrdag.org!

Human Rights Data Analysis Group @hrdag.org · Sep 3

HRDAG stands firmly with the human rights community in insisting that encryption is not optional — it is fundamental to the defense of truth.

Any attempt to ban or backdoor encryption technology is a threat to the human rights community.

hrdag.substack.com/p/without-en...

3

Human Rights Data Analysis Group @hrdag.org · 6d

Words like AI, machine learning, natural language processing, and LLMs are often used interchangeably in popular media. But they mean distinct things.

Our monthly newsletter breaks it down.

hrdag.substack.com/p/pulling-ba...

How can AI uncover hidden truths? We used large language models to examine more than a million pages of California police-misconduct records.

Pulling Back the Curtain on LLMs & Policing Data

4

Human Rights Data Analysis Group @hrdag.org · 6d

Words like AI, machine learning, natural language processing, and LLMs are often used interchangeably in popular media. But they mean distinct things.

Our monthly newsletter breaks it down.

hrdag.substack.com/p/pulling-ba...

How can AI uncover hidden truths? We used large language models to examine more than a million pages of California police-misconduct records.

Human Rights Data Analysis Group @hrdag.org · 7d

How do we assess "accuracy" in the context of LLMs? We need to consider the question from multiple dimensions. hrdag.substack.com/p/pulling-ba...

White text on orange background: One of the most critical questions when assessing LLM outputs is accuracy - but accuracy isn't a single, simple measure. HRDAG.Substack.com

HRDAG - Human Rights Data Analysis Group

Reposted by Human Rights Data Analysis Group

Human Rights Data Analysis Group @hrdag.org · 13d

Where possible, we make our datasets available to other researchers who want to analyze the data themselves or confirm our work.

Check out many of our available datasets here: hrdag.org/data-publica...

Over the last few years, we've tried to make the data organized in our projects publicly accessible. We have encouraged our partners to publish the data at the completion of the project. We continue…

Pulling Back the Curtain on LLMs & Policing Data

1 2

Human Rights Data Analysis Group @hrdag.org · 8d

We turned to LLMs to explore and parse vast quantities of data about police abuses in California. hrdag.substack.com/p/pulling-ba...

How can AI uncover hidden truths? We used large language models to examine more than a million pages of California police-misconduct records.

Human rights workers and everyday citizens are asking: how do we deal with the evolving and very real threats we are facing?

Human Rights Data Analysis Group @hrdag.org · 9d

How do human rights data scientists at @hrdag.org and our partners think about safety when we face threats of violence?

Subscribe and read our free substack newsletter exploring this and other topics: substack.com/home/post/p-...

Scatter and Keep Working

substack.com

Human Rights Data Analysis Group @hrdag.org · 12d

Remember: bias in, bias out.

When data collection fails to include certain communities or locations, any analysis or predictions based on that data will also be infected by bias.

HRDAG - Human Rights Data Analysis Group

Human Rights Data Analysis Group @hrdag.org · 13d

Where possible, we make our datasets available to other researchers who want to analyze the data themselves or confirm our work.

Check out many of our available datasets here: hrdag.org/data-publica...

Over the last few years, we've tried to make the data organized in our projects publicly accessible. We have encouraged our partners to publish the data at the completion of the project. We continue…

HRDAG - Human Rights Data Analysis Group

1 2

Human Rights Data Analysis Group @hrdag.org · 14d

Approximately three-quarters of all homicide victims in America are killed by someone they know.

But the real threat from strangers is quite different from what most fear: one-third of all Americans killed by strangers are killed by police. hrdag.org/violence-in-...

Note from the author (June 2020) The largest public demonstrations in a generation are at this moment demanding reform or abolition of the police in the United States.[1] The overwhelming and…

Convenience Samples: What they are, and what they should (and should not) be used for

2 3

Human Rights Data Analysis Group @hrdag.org · 15d

A convenience sample is any data that is neither a complete enumeration of all the possible data—a census—nor a careful, scientific sample.

Learn why they can be problematic: hrdag.org/2013/04/05/c...

As noted on our Core Concepts page, we spend a lot of time worrying about the ways data are used to make claims about human rights violations. This is because inaccurate statistics can damage the…

Responsible AI: Using AI for Human Rights

Human Rights Data Analysis Group @hrdag.org · 16d

We know that in our work, every number is a human life.

We're thankful for everyone who supports our efforts to bring rigorous scientific analysis to the field of human rights. Thank you for standing with us.

1 1 2

Human Rights Data Analysis Group @hrdag.org · 18d

How can AI be used to support the efforts of human rights workers? HRDAG's executive director Megan Price weighs in. www.youtube.com/watch?v=0fjW...

Enrique Piracés (Carnegie Mellon University) and Megan Price (Human Rights Data Analysis Group) join Jessica Wyndham (AAAS) on International Human Rights Day for an interview about the use of…

www.youtube.com

Structural Zero | Human Rights Data Analysis | Substack

Human Rights Data Analysis Group @hrdag.org · 19d

Subscribe today to our free Substack newsletter to learn how HRDAG uses encryption to fend off attempts to steal or tamper with our sensitive data sets.
hrdag.substack.com

We're 5 data scientists working for a small human rights nonprofit. "Structual Zero" is a monthly newsletter that explores how mathematical and scientific concepts can help us understand the world and...

Want to know a police officer’s job history? There’s a new tool

Human Rights Data Analysis Group @hrdag.org · 20d

Today marks the one year anniversary since HRDAG and our partners at @invisible.institute , Innocence & Justice Louisiana, and Machine Learning Justice Lab launched the National Police Index, a project to shed light on police employment history data. www.nprillinois.org/news/2024-10...

The Invisible Institute helped create the site. Users can select a state, then search an officer’s name, agency or unique identifier number.

www.nprillinois.org

1 5

Human Rights Data Analysis Group @hrdag.org · 20d

This year's Rafto Prize honors the work of Emergency Response Rooms, a network a Sudanese community groups providing aid. We are glad to welcome you to the Rafto Laureate community.

www.rafto.no/en/news/the-...

The Rafto Prize 2025 to Emergency Response Rooms of Sudan (ERR)

The Rafto Prize 2025 is awarded to The Emergency Response Rooms of Sudan (ERRs) for their courageous work to preserve the most fundamental human right - the right to life.

www.rafto.no

3

Human Rights Data Analysis Group @hrdag.org · 20d

This data tool was made possible due to a collaboration between HRDAG, @invisible.institute, Innocence & Justice Louisiana, and Machine Learning Justice Lab. Together, we're using data to bring accountability and justice.

1 3

Human Rights Data Analysis Group @hrdag.org · 20d

Too often, police officers who violate ethics codes switch jurisdictions before facing justice. Today marks one year since the launch of the National Police Index, a tool to shed light on "wandering police officers." hrdag.org/2024/10/16/n...

How a Data Tool Tracks Police Misconduct and Wandering Officers

The Yale Law Journal defines “wandering officers” as law-enforcement officers who are fired by one department, sometimes for serious misconduct, but then find work at another agency. There’s some deba...