@ltgoslo.bsky.social
55 followers
31 following
18 posts
The Language Technology Group (LTG) at the University of Oslo, Norway do research on a range of topics in Natural Language Processing (NLP), including language modeling for Norwegian and other languages.
Posts
Media
Videos
Starter Packs
ltgoslo.bsky.social
@ltgoslo.bsky.social
· Jun 10
Systematic Generalization in Language Models Scales with Information Entropy
Systematic generalization remains challenging for current language models, which are known to be both sensitive to semantically similar permutations of the input and to struggle with known concepts pr...
arxiv.org
ltgoslo.bsky.social
@ltgoslo.bsky.social
· Jun 10
NorEval: A Norwegian Language Understanding and Generation Evaluation Benchmark
This paper introduces NorEval, a new and comprehensive evaluation suite for large-scale standardized benchmarking of Norwegian generative language models (LMs). NorEval consists of 24 high-quality hum...
arxiv.org
ltgoslo.bsky.social
@ltgoslo.bsky.social
· Jun 10
Re-identification of De-identified Documents with Autoregressive Infilling
Documents revealing sensitive information about individuals must typically be de-identified. This de-identification is often done by masking all mentions of personally identifiable information (PII), ...
arxiv.org
ltgoslo.bsky.social
@ltgoslo.bsky.social
· Jun 10
Circuit Compositions: Exploring Modular Structures in Transformer-Based Language Models
A fundamental question in interpretability research is to what extent neural networks, particularly language models, implement reusable functions through subnetworks that can be composed to perform mo...
arxiv.org
ltgoslo.bsky.social
@ltgoslo.bsky.social
· Jun 10