Anna Rogers
@annarogers.bsky.social
Associate professor at IT University of Copenhagen: NLP, language models, interpretability, AI & society. Co-editor-in-chief of ACL Rolling Review. #NLProc #NLP
Reposted by Anna Rogers
i am looking for academic (or similarly "serious") courses or textbook-y texts on LLMs with a major component (lets say >66%) that is NOT about the technicalities of Transformers, optimization, RL, tokenization, etc, but instead focus more on data, eval, interpretability, etc. pointers?
June 3, 2025 at 5:41 PM
i am looking for academic (or similarly "serious") courses or textbook-y texts on LLMs with a major component (lets say >66%) that is NOT about the technicalities of Transformers, optimization, RL, tokenization, etc, but instead focus more on data, eval, interpretability, etc. pointers?
Here's an argument that both 'confabulation' and 'hallucination' imply that something unusual happens and causes an error. But LLMs work exactly as designed, whether their output happens to be factually correct or not. Apparently, the technical term is 'bullshit'.
link.springer.com/article/10.1...
link.springer.com/article/10.1...
ChatGPT is bullshit - Ethics and Information Technology
Recently, there has been considerable interest in large language models: machine learning systems which produce human-like text and dialogue. Applications of these systems have been plagued by persist...
link.springer.com
June 3, 2025 at 2:25 PM
Here's an argument that both 'confabulation' and 'hallucination' imply that something unusual happens and causes an error. But LLMs work exactly as designed, whether their output happens to be factually correct or not. Apparently, the technical term is 'bullshit'.
link.springer.com/article/10.1...
link.springer.com/article/10.1...
🙏 Many thanks to all the co-authors and respondents!
My favorite finding: even professionals who care about intelligence definitions enough to volunteer for a survey, find it hard to specify how they understand it - even as a multi-choice selection of pre-defined criteria.
/8
My favorite finding: even professionals who care about intelligence definitions enough to volunteer for a survey, find it hard to specify how they understand it - even as a multi-choice selection of pre-defined criteria.
/8
June 2, 2025 at 9:27 AM
🙏 Many thanks to all the co-authors and respondents!
My favorite finding: even professionals who care about intelligence definitions enough to volunteer for a survey, find it hard to specify how they understand it - even as a multi-choice selection of pre-defined criteria.
/8
My favorite finding: even professionals who care about intelligence definitions enough to volunteer for a survey, find it hard to specify how they understand it - even as a multi-choice selection of pre-defined criteria.
/8
In light of the debate on 'AI' conferences, it is interesting that the respondents who identified their primary field as 'AI' were among the most skeptical about the current LLMs. This choice of the field name does not necessarily align with the research agenda of 'intelligent technology'.
/7
/7
June 2, 2025 at 9:27 AM
In light of the debate on 'AI' conferences, it is interesting that the respondents who identified their primary field as 'AI' were among the most skeptical about the current LLMs. This choice of the field name does not necessarily align with the research agenda of 'intelligent technology'.
/7
/7
Finally, we asked the respondents about their overall research agenda. Most of them see their goal as adding to scientific knowledge, rather than building 'intelligent' tech. But those who do have the latter goal are also more likely to consider the current LLMs as intelligent.
/6
/6
June 2, 2025 at 9:27 AM
Finally, we asked the respondents about their overall research agenda. Most of them see their goal as adding to scientific knowledge, rather than building 'intelligent' tech. But those who do have the latter goal are also more likely to consider the current LLMs as intelligent.
/6
/6
We also asked the respondents to categorize different entities as intelligent or not (see sec. 4.3 for rationale for this binarization). The number of respondents who made that choice for current LLMs (with ChatGPT as an example) is between those who made the same choice for amoebas and ants. /5
June 2, 2025 at 9:27 AM
We also asked the respondents to categorize different entities as intelligent or not (see sec. 4.3 for rationale for this binarization). The number of respondents who made that choice for current LLMs (with ChatGPT as an example) is between those who made the same choice for amoebas and ants. /5
Here's how many respondents believe that the current and future LLM-based systems can be considered 'intelligent'. We found that students are overall less skeptical than the senior researchers. /4
June 2, 2025 at 9:27 AM
Here's how many respondents believe that the current and future LLM-based systems can be considered 'intelligent'. We found that students are overall less skeptical than the senior researchers. /4
Here's how many researchers considered various criteria of 'intelligence' important, but lacking in the current LLMs. Interestingly, embodiment isn't considered that important. /3
June 2, 2025 at 9:27 AM
Here's how many researchers considered various criteria of 'intelligence' important, but lacking in the current LLMs. Interestingly, embodiment isn't considered that important. /3
Here's who our respondents were by career stage, and which field they identified with as their primary research field: /2
June 2, 2025 at 9:27 AM
Here's who our respondents were by career stage, and which field they identified with as their primary research field: /2
🤯 We use the term 'intelligence' a lot, but wth do we mean?
We got 303 survey responses from researchers. The most agreed-on criteria are generalization, adaptability & reasoning.
ACL Findings preprint: arxiv.org/abs/2505.20959
with @brtrm.bsky.social @terne.bsky.social @heinrichst.bsky.social /1
We got 303 survey responses from researchers. The most agreed-on criteria are generalization, adaptability & reasoning.
ACL Findings preprint: arxiv.org/abs/2505.20959
with @brtrm.bsky.social @terne.bsky.social @heinrichst.bsky.social /1
June 2, 2025 at 9:27 AM
🤯 We use the term 'intelligence' a lot, but wth do we mean?
We got 303 survey responses from researchers. The most agreed-on criteria are generalization, adaptability & reasoning.
ACL Findings preprint: arxiv.org/abs/2505.20959
with @brtrm.bsky.social @terne.bsky.social @heinrichst.bsky.social /1
We got 303 survey responses from researchers. The most agreed-on criteria are generalization, adaptability & reasoning.
ACL Findings preprint: arxiv.org/abs/2505.20959
with @brtrm.bsky.social @terne.bsky.social @heinrichst.bsky.social /1
Co-organized by Aalborg University, the IT University of Copenhagen, and the University of Copenhagen.
Team: @bjerva.bsky.social @delliott.bsky.social @annarogers.bsky.social and our amazing students incl. @arzuburcuguven.bsky.social @motzwanted.bsky.social /2
Team: @bjerva.bsky.social @delliott.bsky.social @annarogers.bsky.social and our amazing students incl. @arzuburcuguven.bsky.social @motzwanted.bsky.social /2
May 26, 2025 at 1:08 PM
Co-organized by Aalborg University, the IT University of Copenhagen, and the University of Copenhagen.
Team: @bjerva.bsky.social @delliott.bsky.social @annarogers.bsky.social and our amazing students incl. @arzuburcuguven.bsky.social @motzwanted.bsky.social /2
Team: @bjerva.bsky.social @delliott.bsky.social @annarogers.bsky.social and our amazing students incl. @arzuburcuguven.bsky.social @motzwanted.bsky.social /2
📢 The Copenhagen NLP Symposium on June 20th!
- Invited talks by @loubnabnl.hf.co (HF) @mziizm.bsky.social (Cohere) @najoung.bsky.social (BU) @kylelo.bsky.social (AI2) Yohei Oseki (UTokyo)
- Exciting posters by other participants
Register to attend and/or present your poster at cphnlp.github.io /1
- Invited talks by @loubnabnl.hf.co (HF) @mziizm.bsky.social (Cohere) @najoung.bsky.social (BU) @kylelo.bsky.social (AI2) Yohei Oseki (UTokyo)
- Exciting posters by other participants
Register to attend and/or present your poster at cphnlp.github.io /1
Copenhagen NLP Symposium 2025
symposium website
cphnlp.github.io
May 26, 2025 at 1:08 PM
📢 The Copenhagen NLP Symposium on June 20th!
- Invited talks by @loubnabnl.hf.co (HF) @mziizm.bsky.social (Cohere) @najoung.bsky.social (BU) @kylelo.bsky.social (AI2) Yohei Oseki (UTokyo)
- Exciting posters by other participants
Register to attend and/or present your poster at cphnlp.github.io /1
- Invited talks by @loubnabnl.hf.co (HF) @mziizm.bsky.social (Cohere) @najoung.bsky.social (BU) @kylelo.bsky.social (AI2) Yohei Oseki (UTokyo)
- Exciting posters by other participants
Register to attend and/or present your poster at cphnlp.github.io /1
Is there a term for the state of "killed yourself over last-minute conference submissions and now need a week to recover"?
Also, any strategies from group leaders who manage to prevent that?
Also, any strategies from group leaders who manage to prevent that?
May 21, 2025 at 7:49 AM
Is there a term for the state of "killed yourself over last-minute conference submissions and now need a week to recover"?
Also, any strategies from group leaders who manage to prevent that?
Also, any strategies from group leaders who manage to prevent that?
Reposted by Anna Rogers
That'd be great to check when we have the bandwidth. But one more way to think about this is the scaling of effort to detect who doesn't help enough, going through their rationales, begging them to do more, checking what happens, etc etc - in parallel to all other jobs. This has to be sustainable.
May 5, 2025 at 3:33 PM
That'd be great to check when we have the bandwidth. But one more way to think about this is the scaling of effort to detect who doesn't help enough, going through their rationales, begging them to do more, checking what happens, etc etc - in parallel to all other jobs. This has to be sustainable.
📢 Breaking changes to EMNLP submissions! If you plan to submit, pls make sure ALL co-authors know that:
- they have to register as reviewers by May 21st (can be done as soon as a paper is submitted)
- if they get assignments, it must be done on time and acc. to guidelines. Penalties now possible!
- they have to register as reviewers by May 21st (can be done as soon as a paper is submitted)
- if they get assignments, it must be done on time and acc. to guidelines. Penalties now possible!
📢 Planning to submit to EMNLP 2025?
Make sure you're up to speed with new ARR policies:
👉 aclrollingreview.org/incentives2025
#NLProc #EMNLP #ARR #ACL (1/2)
Make sure you're up to speed with new ARR policies:
👉 aclrollingreview.org/incentives2025
#NLProc #EMNLP #ARR #ACL (1/2)
Changes to reviewer volunteering requirement and incentives in May 2025 cycle (EMNLP 2025)
TLDR:
aclrollingreview.org
May 5, 2025 at 11:19 AM
📢 Breaking changes to EMNLP submissions! If you plan to submit, pls make sure ALL co-authors know that:
- they have to register as reviewers by May 21st (can be done as soon as a paper is submitted)
- if they get assignments, it must be done on time and acc. to guidelines. Penalties now possible!
- they have to register as reviewers by May 21st (can be done as soon as a paper is submitted)
- if they get assignments, it must be done on time and acc. to guidelines. Penalties now possible!
Reposted by Anna Rogers
IF YOU FOUND YOUR NOVEL IN THE LIBGEN DATABASE, YOU MAY BE A CLASS MEMBER FOR THE KADREY ET AL V. META PLATFORMS CLASS ACTION
Law firms you can contact if you're a potential class member:
Joseph Saveri Law Firm, LLP (415) 500-6800
Mathew Butterick (323) 968-2632 [email protected]
Law firms you can contact if you're a potential class member:
Joseph Saveri Law Firm, LLP (415) 500-6800
Mathew Butterick (323) 968-2632 [email protected]
March 20, 2025 at 7:29 PM
IF YOU FOUND YOUR NOVEL IN THE LIBGEN DATABASE, YOU MAY BE A CLASS MEMBER FOR THE KADREY ET AL V. META PLATFORMS CLASS ACTION
Law firms you can contact if you're a potential class member:
Joseph Saveri Law Firm, LLP (415) 500-6800
Mathew Butterick (323) 968-2632 [email protected]
Law firms you can contact if you're a potential class member:
Joseph Saveri Law Firm, LLP (415) 500-6800
Mathew Butterick (323) 968-2632 [email protected]
Reposted by Anna Rogers
Researchers at the University of Wageningen in the Netherlands have received a questionnaire from the US with questions that are an attack on academic freedom. The University of Leiden advises not to respond www.staff.universiteitleiden.nl/announcement...
Researchers advised not to respond to US questionnaire - Leiden University
Researchers who have received a questionnaire containing political questions from the United States Geological Survey (USGS) or other American government funders such as NIH or ARPA are advised not to...
www.staff.universiteitleiden.nl
March 20, 2025 at 10:03 AM
Researchers at the University of Wageningen in the Netherlands have received a questionnaire from the US with questions that are an attack on academic freedom. The University of Leiden advises not to respond www.staff.universiteitleiden.nl/announcement...
That's just insane! @naaclmeeting.bsky.social
Link to original report: www.lemonde.fr/en/internati...
Link to original report: www.lemonde.fr/en/internati...
Jawdropping.
You would expect this in a dictatorship, not the United States.
This country is unrecognizable.
You would expect this in a dictatorship, not the United States.
This country is unrecognizable.
March 20, 2025 at 11:54 AM
That's just insane! @naaclmeeting.bsky.social
Link to original report: www.lemonde.fr/en/internati...
Link to original report: www.lemonde.fr/en/internati...
And then they were systematically replaced. Russians and Ukrainians were incentivized to move to Crimea, creating the current Russian-speaking majority that considers Crimea 'historically theirs'.
March 18, 2025 at 9:31 AM
And then they were systematically replaced. Russians and Ukrainians were incentivized to move to Crimea, creating the current Russian-speaking majority that considers Crimea 'historically theirs'.
One week left to apply!
Perks: a sane country with great infrastructure, healthcare, and biking lanes.
Perks: a sane country with great infrastructure, healthcare, and biking lanes.
📢 #nlp #jobs A postdoc for an interdisciplinary project (sociology+NLP), to work on methodology for qualitative interviews with LLMs. This is a NLP position, but some soc/psy background is a plus.
Domain PI: @hjalmarcarlsen.bsky.social
Apply by March 17
candidate.hr-manager.net/ApplicationI...
Domain PI: @hjalmarcarlsen.bsky.social
Apply by March 17
candidate.hr-manager.net/ApplicationI...
Postdoc position in Scaling Up Qualitative Interviews with Large Language Models at IT University of Copenhagen
The IT University of Copenhagen invites highly motivated candidates to apply for a postdoc position. The earliest possible starting date is 1 May 2025. The IT U
candidate.hr-manager.net
March 10, 2025 at 11:03 AM
One week left to apply!
Perks: a sane country with great infrastructure, healthcare, and biking lanes.
Perks: a sane country with great infrastructure, healthcare, and biking lanes.
Reposted by Anna Rogers
This guy, @albertburneko.bsky.social, is a genius. Please read his brilliant article on Elon Musk's deranged and morally repugnant Mars colonisation schtick. defector.com/neither-elon...
Neither Elon Musk Nor Anybody Else Will Ever Colonize Mars | Defector
Mars does not have a magnetosphere. Any discussion of humans ever settling the red planet can stop right there, but of course it never does. Do you have a low-cost plan for, uh, creating a gigantic ac...
defector.com
March 7, 2025 at 9:05 AM
This guy, @albertburneko.bsky.social, is a genius. Please read his brilliant article on Elon Musk's deranged and morally repugnant Mars colonisation schtick. defector.com/neither-elon...
Reposted by Anna Rogers
Finland is making a significant investment in the future of machine learning / artificial intelligence by hiring 20 professors (at various levels) www.ellisinstitute.fi/ellis-instit...
PI positions | ELLIS Institute Finland
ELLIS Institute Finland PI positions
www.ellisinstitute.fi
February 28, 2025 at 7:17 AM
Finland is making a significant investment in the future of machine learning / artificial intelligence by hiring 20 professors (at various levels) www.ellisinstitute.fi/ellis-instit...
It was/is discussed by various groups, but it is really complex, and different places have different co-authorship cultures, and there are many other fires going on. For now, this option should at least enable big groups to better cover their share of reviewing.
February 23, 2025 at 4:01 PM
It was/is discussed by various groups, but it is really complex, and different places have different co-authorship cultures, and there are many other fires going on. For now, this option should at least enable big groups to better cover their share of reviewing.