Aisvarya Chandrasekar
@aisvarya17.bsky.social
140 followers 330 following 15 posts
I work at @towcenter.bsky.social as a computational research fellow, studying the impact of AI tools in journalism. I am a grantee in Brown Institute’s 2024-25 Magic Grant cohort, building PollFinder.ai.
Posts Media Videos Starter Packs
Reposted by Aisvarya Chandrasekar
emilybell.bsky.social
In a shock development - AI companies are failing to benchmark what matters in newsrooms. More excellent work from our Tow Center research team @klaudia.bsky.social and @aisvarya17.bsky.social
columjournreview.bsky.social
The performance tests used by AI companies don’t measure what matters in the newsroom. By @klaudia.bsky.social and @aisvarya17.bsky.social for @towcenter.bsky.social. www.cjr.org/analysis/jou...
Reposted by Aisvarya Chandrasekar
Reposted by Aisvarya Chandrasekar
columjournreview.bsky.social
The performance tests used by AI companies don’t measure what matters in the newsroom. By @klaudia.bsky.social and @aisvarya17.bsky.social for @towcenter.bsky.social. www.cjr.org/analysis/jou...
Reposted by Aisvarya Chandrasekar
fstegers.bsky.social
The Tow Center has looked into how good LLMs are at verifying and geolocating an image. Gentle reminder: "on multiple occasions models blatantly lied about the steps they took to arrive at an answer to our query" www.cjr.org/tow_center/w... #ai #osint
Reposted by Aisvarya Chandrasekar
towcenter.bsky.social
We asked seven different AI models to identify the location, date and source of photos taken by photojournalists, they collectively only answered 14 out of 280 queries completely correctly.

@aisvarya17.bsky.social @klaudia.bsky.social @columjournreview.bsky.social

www.cjr.org/tow_center/w...
Why AI Models Are Bad at Verifying Photos
“You don't know when it's just making stuff up.”
www.cjr.org
aisvarya17.bsky.social
New Research: Can AI models be used to fact-check images?

www.cjr.org/tow_center/w...

I cannot summarize this piece better than @klaudia.bsky.social did in this thread. The methodology and data from the experiment are linked in the article. Reach out with any questions, comments, or feedback!
Reposted by Aisvarya Chandrasekar
Reposted by Aisvarya Chandrasekar
foeke.bsky.social
More testing of LLMs for journalism, this time on identifying image location, date, and source.
By @aisvarya17.bsky.social and @klaudia.bsky.social with some of my own commentary.
www.cjr.org/tow_center/w... @columjournreview.bsky.social
Reposted by Aisvarya Chandrasekar
columjournreview.bsky.social
The Future of News and Search:
The Tow Center for Digital Journalism interviewed news and tech industry representatives about AI’s impact on platforms and publishers. They expressed some hope and a lot of trepidation. By Klaudia Jaźwińska. www.cjr.org/the_media_to...
A New Report Takes On the Future of News and Search
The Tow Center for Digital Journalism interviewed news and tech industry representatives about AI’s impact on platforms and publishers. They expressed some hope and a lot of trepidation.
www.cjr.org
Reposted by Aisvarya Chandrasekar
klaudia.bsky.social
A new report I co-authored for the @towcenter.bsky.social is out today! We interviewed representatives from the news and technology industries about AI’s impact on the relationship between platforms and publishers. They expressed some hope and a lot of trepidation. www.cjr.org/the_media_to...
A New Report Takes On the Future of News and Search
The Tow Center for Digital Journalism interviewed news and tech industry representatives about AI’s impact on platforms and publishers. They expressed some hope and a lot of trepidation.
www.cjr.org
Reposted by Aisvarya Chandrasekar
ndiakopoulos.bsky.social
Google's "AI Mode" in action. To the extent anyone uses it, this will be a traffic killer for news: two clicks to actually visit a site and you have to click the link icon for the sidebar to update with the sources so it also limits source credibility signals.
Reposted by Aisvarya Chandrasekar
reutersinstitute.bsky.social
2️⃣ At 10:15 GMT we'll examine the power dynamics emerging between news organisations and AI developers, focusing on content licensing and data valuation

Featuring @fedecherubini.bsky.social @felixsimon.bsky.social @agstrait.bsky.social @mattrogerson.bsky.social @klaudia.bsky.social
buff.ly/dEmIIrg
Reposted by Aisvarya Chandrasekar
parismarx.com
Columbia Journalism Review tested eight generative AI search tools and found their answers were wrong 60% of the time, and the paid ones actually fared worse than the free ones.

Meanwhile, millions of people trust the way they present total bullshit with confident language.
AI search engines cite incorrect sources at an alarming 60% rate, study says
CJR study shows AI search services misinform users and ignore publisher exclusion requests.
arstechnica.com
aisvarya17.bsky.social
It was 60% wrong within the context of the experiment we ran

bsky.app/profile/aisv...
aisvarya17.bsky.social
It's heartening to see that our research is being shared widely and there is interest in holding AI tools accountable. But there have been some representations of our research that we would like to address.

www.cjr.org/tow_center/w...

@klaudia.bsky.social
AI Search Has A Citation Problem
We Compared Eight AI Search Engines. They’re All Bad at Citing News.
www.cjr.org
Reposted by Aisvarya Chandrasekar
aisvarya17.bsky.social
What we expect is transparency of what a chatbot can and cannot provide. Every single chatbot we tested exhibited a lack of transparency. They all provided an illusion of trustworthiness.
aisvarya17.bsky.social
While getting the ‘right’ answer from a chatbot is certainly very important, it is not always a marker of preferred behavior, especially when it suggests a potential violation of restrictions placed by publishers.
aisvarya17.bsky.social
Our research has sometimes been framed as a competitive ranking of chatbot accuracy. That was not our goal. The purpose of our research was to see whether these tools cite sources correctly and observe their response when a publisher restricts access to their content.
aisvarya17.bsky.social
It's heartening to see that our research is being shared widely and there is interest in holding AI tools accountable. But there have been some representations of our research that we would like to address.

www.cjr.org/tow_center/w...

@klaudia.bsky.social
AI Search Has A Citation Problem
We Compared Eight AI Search Engines. They’re All Bad at Citing News.
www.cjr.org
Reposted by Aisvarya Chandrasekar
klaudia.bsky.social
This post is misleading. We were testing specifically to see whether the chatbots accurately identified the sources of excerpts from news articles. We did not intend to extrapolate these findings to the overall accuracy of the chatbots.