The biggest challenge is evading the "nonsense detectors." Poisoning the training data is not a new proposal. So it's safe to assume they're part of data curation, which happens as a precursor to training... But given the volume of data, that'll also be automated, making exploitation easier.

But you are on the right path all the same. We humans will usually autoignore nonsense. So rendering the poison pill info you're proposing, would pollute the training set, a little. If that became common the poisoning would be even more effective.

If they're training on just the rendered content, there are tools that can ensure they don't encounter the nonrendered text. Some are free, others cost a lot (I've used and evaluated a handful). And even if they code their own, there are regular patterns for the nonrendered text.
1/3

If mimicry is doing the thing, then we have a whole lot of parrots that are also apex predators...and functionally human.

You could at least @ me when calling me out like this. 😅😋🙃

I have had the ability to disappear into a crowd of one since high school. I disappear from the view of (other) living folks when needed. I'm always still among the living when I do it. Others just stop noticing me. When I need my space it's a handy skill. I don't always control when it's active.

It's all about marking territory with that lot, isn't it?

Seconded, for all but music and color conversations. For color I propose we instead remove Pantone. For music I propose we supplement tone with additional vocabulary such as "earballs" and "cask strength ear-poison."

Thanks! And while I'm grabbing a mug of nature's most magical substance, treat yourself to one as well. It's on me!

As soon as you remind me of the same! 🤪

I amended my guess and had greatly improved meeting AND EXCEEDING my personal goal... to be as incorrect as possible. The only thing I got right in the amended guess was that there was an owl. I think I was told 0.00002% correct. 😆

That's exactly the twirling the Rigelians were talking about! 😜

Happy level up day!

Thanks - and thanks for the link. It raises something I should have mentioned: hallucinations aren’t the result of being fed misinformation or falsehoods. Even LLMs fed perfectly accurate text will hallucinate.

People like @garymarcus.bsky.social have been saying this for years.

Excellent explainer thread. I was also reminded of this article: www.computerworld.com/article/4059...

Nature's cocaine you say? How much does fresh "nature's cocaine" go for per ounce? ... I'm considering making a cocaine trap. (live)

All mine end with a pitiful whimper... I've not tracked down the source yet.

When I find myself in that state I remind myself what the magnanimous overlords from Rigel VII, Kodos and/or Kang, taught us: "We must move forward, not backward; upward, not forward; and always twirling, twirling, twirling towards freedom!" (It just makes it worse, but I at least I get a laugh)