Robin
@robinst42.bsky.social
🔎 Data journalism, computer science, Design
👨💻 Based in Dortmund, Germany
👨💻 Based in Dortmund, Germany
Weaker Foundation Models can imitate better larger models and can become incredibly good, even reducing toxic content output. But they are also better at fooling users and are more likely to just mimic the well structured style rather than the original learned content:
arxiv.org/abs/2305.15717
arxiv.org/abs/2305.15717
The False Promise of Imitating Proprietary LLMs
An emerging method to cheaply improve a weaker language model is to finetune it on outputs from a stronger model, such as a proprietary system like ChatGPT (e.g., Alpaca, Self-Instruct, and others). T...
arxiv.org
April 3, 2025 at 12:08 AM
Weaker Foundation Models can imitate better larger models and can become incredibly good, even reducing toxic content output. But they are also better at fooling users and are more likely to just mimic the well structured style rather than the original learned content:
arxiv.org/abs/2305.15717
arxiv.org/abs/2305.15717
Hello world! Looking to connect with data journalists and investigative journalists :)
April 2, 2025 at 11:48 PM
Hello world! Looking to connect with data journalists and investigative journalists :)