Ondrej Dusek
@tuetschek.bsky.social
470 followers 270 following 7 posts
Teaching computers to talk at Charles University. (Computational) linguistics, politics, climate, public transit. He/him.
Posts Media Videos Starter Packs
Reposted by Ondrej Dusek
siggen.bsky.social
The registration page for #INLG2025 is now live! Join us in Vietnam at the Oct 29 - Nov 2 for the best conference on #NaturalLanguageGeneration

2025.inlgmeeting.org/registration...

Curious to see what will be presented? Check out this list of accepted papers! 2025.inlgmeeting.org/accepted-pap...
Picture of the One Pillar Pagoda in Hanoi, a pagoda raised up over a green pond surrounded by greenery
Reposted by Ondrej Dusek
vendi12.bsky.social
Check out the slides from our SCAI'2025 #convsearch workshop collocated with @ijcai.org #IJCAI2025 on LLMs, retrieval & QA, recommendations, negotiations, evaluation and transparency

scai.info/scai-2025

@patuchen.bsky.social @maik-froebe.bsky.social @tuetschek.bsky.social @mila-quebec.bsky.social
SCAI 2025
Online Event on Search-Oriented Conversational AI.
scai.info
Reposted by Ondrej Dusek
ivankartac.bsky.social
Our paper "OpeNLGauge: An Explainable Metric for NLG Evaluation with Open-Weights LLMs" has been accepted to #INLG2025 conference!

You can read the preprint here: arxiv.org/abs/2503.11858
tuetschek.bsky.social
It's fine by me if they generate it, as long as it works and they know how... but I've been getting loads of roughly plausible but non-functional code, with hallucinated API calls etc. 😒. Not that many emojis though (in docs only).
Reposted by Ondrej Dusek
ufal.mff.cuni.cz
FreshTab: Sourcing Fresh Resources for Table-to-Text Generation Evaluation
by @navitas.bsky.social, ‪@oplatek.bsky.social‬, ‪@zdenekkasner.bsky.social‬, @tuetschek.bsky.social .bsky.social‬
Reposted by Ondrej Dusek
ufal.mff.cuni.cz
ReproHum #0669-08: Reproducing Sentiment Transfer Evaluation
by @navitas.bsky.social, M. Lango, @patuchen.bsky.social, @tuetschek.bsky.social
Challenge to reproduce human evaluations from NLP papers, testing the reproducibility of evaluation studies
Reposted by Ondrej Dusek
ufal.mff.cuni.cz
OpeNLGauge: An Explainable Metric for NLG Evaluation with Open-Weights LLMs
by @ivankartac.bsky.social, M. Lango, @tuetschek.bsky.social
arxiv.org/abs/2503.11858
Open-source NLG evaluation metric that explains errors and matches human judgments without proprietary models
Reposted by Ondrej Dusek
ufal.mff.cuni.cz
#ACL2025NLP in Vienna 🇦🇹 starts today with 23 🤯 @ufal-cuni.bsky.social folks presenting their work both at the main conference and workshops. Check out our main conference papers today and on Wednesday 👇
Reposted by Ondrej Dusek
markriedl.bsky.social
ICML found hidden prompts in accepted papers. They have released a statement icml.cc/Conferences/...

Yes, it’s unacceptable. So is using an LLM to review a paper. Peer review is so broken.
Reposted by Ondrej Dusek
tbskyen.com
TBSkyen @tbskyen.com · May 17
#Eurovision is tonight, and here's a hilarious fun fact about it: Israel has started a massive offensive against civilian populations in Gaza with the explicit aim of conquering the entire territory and ethnically cleansing its population, and Eurovision has aggressively refused to give a shit.
Reposted by Ondrej Dusek
bencollins.bsky.social
It is a little weird to me countries aren’t more aggressively, formally trying to take advantage of the U.S. science brain drain. Once in a lifetime opportunity to buy low on Non-Dumbass Americans with PhDs who just wanna look into microscopes and quietly cure ass cancer as our country eats shit.
Reposted by Ondrej Dusek
ufal.mff.cuni.cz
The 👉Machine Learning Prague 2025👈 is happening right now! Today, @patuchen.bsky.social and @navitas.bsky.social presented their posters on text generation with LLMs. Also, don't miss @tuetschek.bsky.social's invited talk tomorrow at 11 a.m.
Reposted by Ondrej Dusek
tokshop.bsky.social
🚨 NEW WORKSHOP ALERT 🚨

We're thrilled to announce the first-ever Tokenization Workshop (TokShop) at #ICML2025 @icmlconf.bsky.social! 🎉

Submissions are open for work on tokenization across all areas of machine learning.

📅 Submission deadline: May 30, 2025
🔗 tokenization-workshop.github.io
Tokenization Workshop @ ICML 2025
tokenization-workshop.github.io
Reposted by Ondrej Dusek
leyawn.bsky.social
“is my calculator horny?“ our tech columnist asks. “i entered 5318008 into it and turned it upside down. what i saw surprised me”
nytimes.com
“Can ChatGPT experience joy or suffering? Does Gemini deserve human rights?” our tech columnist asks. “Many A.I. experts I know would say no, not yet, not even close. But I was intrigued.”
Should We Start Taking the Welfare of A.I. Seriously?
As artificial intelligence systems become smarter, one A.I. company is trying to figure out what to do if they become conscious.
www.nytimes.com
Reposted by Ondrej Dusek
zdenekkasner.bsky.social
How do LLMs compare to human crowdworkers in annotating text spans? 🧑🤖

And how can span annotation help us with evaluating texts?

Find out in our new paper: llm-span-annotators.github.io

Arxiv: arxiv.org/abs/2504.08697
Large Language Models as Span Annotators
Website for the paper Large Language Models as Span Annotators
llm-span-annotators.github.io
Reposted by Ondrej Dusek
ufal.mff.cuni.cz
Participate in the 👉 CRAC 2025 Shared Task on Multilingual Coreference Resolution❗ ufal.mff.cuni.cz/corefud/crac25
If you have not already done so, register first. 👆 Then start discovering how words refer to each other in 1️⃣7️⃣ languages. This year includes a new ✨LLM✨ track 😮.
Reposted by Ondrej Dusek
carnage4life.bsky.social
It’s kind of quaint to think the big worry a few years ago was that AI chatbots would destroy humanity. We’re quite capable of doing that without their help.
tuetschek.bsky.social
Sadly they're not "exposed" to the millions of people who don't follow politics and consume shitty media 😕
Reposted by Ondrej Dusek
chriswolfvision.bsky.social
The CVPR program chairs acted on the reviewing crisis in ML/CV conferences. This is a first!

Papers of authors who acted as irresponsable reviewers have been desk rejected. 19 papers are affected in 2025.

This has also been announced for ICCV 2025.
Reposted by Ondrej Dusek
ufal.mff.cuni.cz
The 6th International Workshop on Designing Meaning Representation (#DMR2025) will be in Prague, Aug 4-5, right after #ACL2025 in Vienna!

Submit your work on meaning representations: annotation, parsing, multilinguality, neuro-symbolic methods & more. Details: dmr2025.github.io/index
DMR 2025
The 6th International Workshop on Designing Meaning Representations
dmr2025.github.io
Reposted by Ondrej Dusek
strubell.bsky.social
Ok here's the theory so far for how the LLM-generated ARR submission experiment went down. Researchers generated papers, then created fake reviewer profiles by identifying existing papers from a real author st the set of papers would maximize expertise affinity score wrt the LLM-generated paper.