Lightnews — Scholar-powered news

CSET's Recommendations for an AI Action Plan | Center for Security and Emerging Technology

2 1

Reposted by Mia Hoffmann

Vikram Venkatram @vikramvenkatram.bsky.social · Jul 24

Yesterday's new AI Action Plan has a lot worth discussing!

One interesting aspect is its statement that the federal government should withhold AI-related funding from states with "burdensome AI regulations."

This could be cause for concern.

1 3 5

Reposted by Mia Hoffmann

CSET @csetgeorgetown.bsky.social · May 28

⚖️ New Explainer!

Effectively evaluating AI models is more crucial than ever. But how do AI evaluations actually work?

In their new explainer,
@jessicaji.bsky.social, @vikramvenkatram.bsky.social &
@stephbatalis.bsky.social break down the different fundamental types of AI safety evaluations.

1 2 4

Reposted by Mia Hoffmann

Helen Toner @hlntnr.bsky.social · May 19

💡Funding opportunity—share with your AI research networks💡

Internal deployments of frontier AI models are an underexplored source of risk. My program at @csetgeorgetown.bsky.social just opened a call for research ideas—EOIs due Jun 30.

Full details ➡️ cset.georgetown.edu/wp-content/u...

Summary ⬇️

1 5 9

Mia Hoffmann @miahoffmann.bsky.social · Mar 17

11) And if you’re now curious about CSET’s other recommendations for the AI Action Plan, you can check out the full response to the RFI here: cset.georgetown.edu/publication/...

In response to the Office of Science and Technology Policy's request for input on an AI Action Plan, CSET provides key recommendations for advancing AI research, ensuring U.S. competitiveness, and max...

Tech & Society Week 2025 — AI Hazards: Understanding AI Incidents - Massive Data Institute

Mia Hoffmann @miahoffmann.bsky.social · Mar 17

10) If you’re still doubting the benefits of AI incident tracking, come by the Massive Data Institute’s event on "AI Hazards: Understanding AI Incidents" today at 3pm, and let me and my fabulous co-panelists convince you in person! mdi.georgetown.edu/events/tswee...

On Monday, March 17, 2025 from 3:00 to 4:00pm in Fisher Colloquium in Hariri Building on the Hilltop Campus, we will be hosting a panel discussion on AI incidents during Tech & Society Week 2025. The ...

mdi.georgetown.edu

Mia Hoffmann @miahoffmann.bsky.social · Mar 17

Finally, and critically: central data collection and dissemination of lessons learned means that harms only have to occur once for everyone to mitigate their risk. This prevents recurrence and builds user and consumer confidence, which is essential for widespread AI adoption.

Mia Hoffmann @miahoffmann.bsky.social · Mar 17

Incident tracking also reveals new, unexpected AI failure modes that we aren’t yet mitigating against. Over time, systematic data collection can help detect emerging risks and new types of harms, a critical benefit given the fast pace of AI innovation and deployment.

Mia Hoffmann @miahoffmann.bsky.social · Mar 17

Over time, incident data can be used to evaluate the effectiveness of new safety policies and regulation through before and after comparisons. This helps refine governance policies through a direct feedback loop.

Mia Hoffmann @miahoffmann.bsky.social · Mar 17

Using real-world data on what works and what doesn’t to guide AI safety research will help us innovate quicker and build reliable systems that are safe to deploy faster. In this way, incident reporting can help prioritize and direct AI safety research to where it is most effective.

Mia Hoffmann @miahoffmann.bsky.social · Mar 17

AI incidents also shed light on the effectiveness of existing safety efforts. We might learn where current technical standards or risk management processes are insufficient to protect people from harm, revealing critical gaps that can be addressed by AI safety research.

Mia Hoffmann @miahoffmann.bsky.social · Mar 17

For instance, we can learn about *how* the use of AI results in harm, e.g. through misuse, user error or AI failure. This information helps channel resources to the right kinds of safety efforts, since preventing misuse requires different measures than addressing operator error.

Mia Hoffmann @miahoffmann.bsky.social · Mar 17

Why should the government do this?
What makes AI risk management so tricky is predicting how deploying an AI system can go wrong. AI incidents are a rich source of information about AI harms, harm mechanisms, AI failure modes and more. Leveraging those insights can make AI use safer.

Mia Hoffmann @miahoffmann.bsky.social · Mar 17

Broadly speaking, an AI incident reporting regime has 4 core parts:
1) Incident detection;
2) Reporting to oversight bodies and inclusion in incident database;
3) Performance of impact assessments and root cause analyses; and
4) Dissemination of lessons learned

Welcome to the Artificial Intelligence Incident Database

Mia Hoffmann @miahoffmann.bsky.social · Mar 17

First, a definition. AI incidents are situations in which a deployed AI system is implicated in harm, e.g. when an AI recruiting tool makes a biased hiring decision. Incidents are varied and often take unexpected forms, so go check out the AIID for more real-world examples! incidentdatabase.ai

The starting point for information about the AI Incident Database

incidentdatabase.ai

Media Engagement Specialist | Center for Security and Emerging Technology

Mia Hoffmann @miahoffmann.bsky.social · Mar 17

Today, @csetgeorgetown.bsky.social published our recommendations for the U.S. AI Action Plan. One of them is a CSET evergreen: implement an AI incident reporting regime for AI used by the federal government. Why? Short answer: because we can learn a ton from incidents! Long answer: 👇

1 2 5

Reposted by Mia Hoffmann

CSET @csetgeorgetown.bsky.social · Mar 14

🚨We're hiring — only a few days left to apply!🚨

CSET is looking for a Media Engagement Specialist to amplify our research. If you're a strategic communicator who can craft press releases, media pitches, & social content, apply by March 17, 2025! cset.georgetown.edu/job/media-en...

The Center for Security and Emerging Technology, under the School of Foreign Service, is a research organization focused on studying the security impacts of emerging technologies, supporting academic ...

What’s Next for AI Red-Teaming? | Center for Security and Emerging Technology

2

Reposted by Mia Hoffmann

CSET @csetgeorgetown.bsky.social · Mar 12

What: CSET Webinar 📺
When: Tuesday, 3/25 at 12PM ET 📅

What’s next for AI red-teaming? And how do we make it more useful?

Join Tori Westerhoff, Christina Liaghati, Marius Hobbhahn, and CSET's @dr-bly.bsky.social * @jessicaji.bsky.social for a great discussion: cset.georgetown.edu/event/whats-...

On March 25, CSET will host an in-depth discussion about AI red-teaming — what it is, how it works in practice, and how to make it more useful in the future.

Out of Balance: What the EU's Strategy Shift Means for the AI Ecosystem | TechPolicy.Press

4 4

Reposted by Mia Hoffmann

CSET @csetgeorgetown.bsky.social · Mar 10

What does the EU's shifting strategy mean for AI?

CSET's @miahoffmann.bsky.social & @ojdaniels.bsky.social have a new piece out for @techpolicypress.bsky.social.

Read it now 👇

Mia Hoffmann @miahoffmann.bsky.social · Mar 10

If you’ve ever wondered what the EU and elephants have in common - or are wondering now- read my latest piece with @ojdaniels.bsky.social! We take a look what the EU’s new innovation-friendly regulatory approach might mean for the global AI policy ecosystem www.techpolicy.press/out-of-balan...

Mia Hoffmann and Owen J. Daniels from Georgetown’s Center for Security and Emerging Technology say Europe's movements could change the global landscape.

www.techpolicy.press

4 4

Reposted by Mia Hoffmann

Tech Policy Press @techpolicypress.bsky.social · Mar 10

Mia Hoffmann and Owen J. Daniels from Georgetown’s Center for Security and Emerging Technology say Europe's apparent shift on AI policy could change the global landscape for AI governance.

Out of Balance: What the EU's Strategy Shift Means for the AI Ecosystem | TechPolicy.Press

Mia Hoffmann and Owen J. Daniels from Georgetown’s Center for Security and Emerging Technology say Europe's movements could change the global landscape.

buff.ly

3 6

Mia Hoffmann @miahoffmann.bsky.social · Mar 10

If you’ve ever wondered what the EU and elephants have in common - or are wondering now- read my latest piece with @ojdaniels.bsky.social! We take a look what the EU’s new innovation-friendly regulatory approach might mean for the global AI policy ecosystem www.techpolicy.press/out-of-balan...

Out of Balance: What the EU's Strategy Shift Means for the AI Ecosystem | TechPolicy.Press

Mia Hoffmann and Owen J. Daniels from Georgetown’s Center for Security and Emerging Technology say Europe's movements could change the global landscape.

www.techpolicy.press

1 2

Reposted by Mia Hoffmann

CSET @csetgeorgetown.bsky.social · Mar 3

CSET is hiring 📢

We’re hiring a software engineer to support @emergingtechobs.bsky.social. Help build high-quality public tools and datasets to inform critical decisions on emerging tech issues.

Interested or know someone who would be? Learn more and apply 👇 cset.georgetown.edu/job/software...

Software Engineer | Center for Security and Emerging Technology

The Center for Security and Emerging Technology (CSET), under the School of Foreign Service, is hiring a Software Engineer. The Software Engineer will be a generalist who can flex between full-stack w...