Shaily
@shaily99.bsky.social
3.2K followers 530 following 300 posts
PhDing at LTI, CMU Prev: Ai2, Google Research, MSR Evaluating language technologies, regularly ranting, and probably procrastinating. https://sites.google.com/view/shailybhatt/
Posts Media Videos Starter Packs
Pinned
shaily99.bsky.social
🖋️ Curious how writing differs across (research) cultures?
🚩 Tired of “cultural” evals that don't consult people?

We engaged with interdisciplinary researchers to identify & measure ✨cultural norms✨in scientific writing, and show that❗LLMs flatten them❗

📜 arxiv.org/abs/2506.00784

[1/11]
An overview of the work “Research Borderlands: Analysing Writing Across Research Cultures” by Shaily Bhatt, Tal August, and Maria Antoniak. The overview describes that We  survey and interview interdisciplinary researchers (§3) to develop a framework of writing norms that vary across research cultures (§4) and operationalise them using computational metrics (§5). We then use this evaluation suite for two large-scale quantitative analyses: (a) surfacing variations in writing across 11 communities (§6); (b) evaluating the cultural competence of LLMs when adapting writing from one community to another (§7).
shaily99.bsky.social
I now have a notion page that i made when i did this ages ago and i blindly follow 2023 me and am grateful to her.
Reposted by Shaily
mariaa.bsky.social
Here’s a #COLM2025 feed!

Pin it 📌 to follow along with the conference this week!
Reposted by Shaily
jmendelsohn2.bsky.social
I will be at #COLM2025 this week, and would love to connect with folks interested in applications (and critiques) of language modeling in social science research!

And join us for the NLP4Democracy workshop on Friday!

sites.google.com/andrew.cmu.e...

#NLP #NLProc #LLM #ComputationalSocialScience
NLP 4 Democracy - COLM 2025
sites.google.com
Reposted by Shaily
nsubramani23.bsky.social
At @colmweb.org all week 🥯🍁! Presenting 3 mechinterp + actionable interp papers at @interplay-workshop.bsky.social

1. BERTology in the Modern World w/ @bearseascape.bsky.social
2. MICE for CATs
3. LLM Microscope w/ Jiarui Liu, Jivitesh Jain, @monadiab77.bsky.social

Reach out to chat! #COLM2025
Reposted by Shaily
841io.bsky.social
In January, Asia Biega (MPI), Georgina Born (UCL), Mary Gray (MSR), Rida Qadri (G), and I ran a Dagstuhl Seminar bringing together folks from CS and the broader social sciences to discuss questions around AI and culture. Dagstuhl has just posted our report, 1/3

drops.dagstuhl.de/storage/04da...
Reposted by Shaily
lasha.bsky.social
It is PhD application season again 🍂 For those looking to do a PhD in AI, these are some useful resources 🤖:

1. Examples of statements of purpose (SOPs) for computer science PhD programs: cs-sop.org [1/4]
CS PhD Statements of Purpose
cs-sop.org is a platform intended to help CS PhD applicants. It hosts a database of example statements of purpose (SoP) shared by previous applicants to Computer Science PhD programs.
cs-sop.org
Reposted by Shaily
jessyjli.bsky.social
All of us (@kanishka.bsky.social @kmahowald.bsky.social and me) are looking for PhD students this cycle! If computational linguistics/NLP is your passion, join us at UT Austin!

For my areas see jessyli.com
shaily99.bsky.social
You guys are writing at 9 AM !!!!!!!!!!!!!!!!!
Reposted by Shaily
naitian.org
I've written really terrible paragraphs that have made me want to stop at 9AM in the morning.
shaily99.bsky.social
@danishpruthi.bsky.social
Kalika Bali at MSR (don't think she's on here)
Reposted by Shaily
yanai.bsky.social
Organizing a workshop? Checkout our compiled material for organizing one: www.bigpictureworkshop.com/open-workshop

(and hopefully we'll be back for another iteration of the Big Picture next year w/ Allyson Ettinger, @norakassner.bsky.social, @sebruder.bsky.social)
Big Picture Workshop - Open Workshop
Open sourcing the workshop
www.bigpictureworkshop.com
Reposted by Shaily
tedunderwood.com
New preprint on "Computational Hermeneutics," co-authored by too many people to list in one post. TL;DR: GenAI is a cultural technology, and needs to be evaluated in ways that recognize situatedness, plurality, and ambiguity as the conditions of meaning — not noise to be minimized.
Computational Hermeneutics: Evaluating Generative AI as a Cultural Technology
<div> <div> <div> <p>Generative AI (GenAI) systems are increasingly recognized as cultural technologies, yet current evaluation frameworks often treat cul
papers.ssrn.com
shaily99.bsky.social
I would love to know more about the findings.
Reposted by Shaily
rnv.bsky.social
Happy to share that our work on multi-modal framing analysis of news was accepted to #EMNLP2025!

Understanding news output and embedded biases is especially important in today's environment and it's imperative to take a holistic look at it.

Looking forward to presenting it in Suzhou!
rnv.bsky.social
🚨New pre-print 🚨

News articles often convey different things in text vs. image. Recent work in computational framing analysis has analysed the article text but the corresponding images in those articles have been overlooked.
We propose multi-modal framing analysis of news: arxiv.org/abs/2503.20960
Reposted by Shaily
shaily99.bsky.social
Page are joke. Must to succinctly.
shaily99.bsky.social
but what if they remove what you typed immediately after :'0
Reposted by Shaily
nedjmaou-nlp.bsky.social
The Call for #EMNLP2025 @emnlpmeeting.bsky.social student volunteers is out:
2025.emnlp.org/calls/volunt...
Please fill out the form by 20 Sep 2026 : forms.gle/qfTkVGyDitXi...
For questions, you can contact emnlp2025-student-volunteer-chairs [at] googlegroups [dot] com
Call for Volunteers
Official website for the 2025 Conference on Empirical Methods in Natural Language Processing
2025.emnlp.org
Reposted by Shaily
upolehsan.bsky.social
The Onion used to make jokes.
Now it does academic ethnography.
shaily99.bsky.social
welcome back to NA
shaily99.bsky.social
I was this close to just asking Maria haha. Sounds about right, thanks for pointing me to it.
shaily99.bsky.social
are there any bsky #acl2025 feed around already?
shaily99.bsky.social
#IC2S2 was so much fun, now see you at Vienna at #aclnlp2025. Fine me around the conference or in the poster session on Wednesday at 11 talking about this work, cultural competence in LLMs, and evaluation.
ltiatcmu.bsky.social
Congrats (and well done!) to LTI PhD student Shaily Bhatt on her plenary lightning talk at #IC2S2