Bill Tsukuda
banner
btsukuda.bsky.social
Bill Tsukuda
@btsukuda.bsky.social
I want to be a rider like my father. Ignore me.
What are you doing with the lentils?
January 7, 2026 at 12:53 AM
I always thought this was one of the weaker songs in the Rolling Stones catalog.
January 2, 2026 at 1:31 AM
Is this a sign?
January 2, 2026 at 12:25 AM
How do you mess up a timer?
December 24, 2025 at 7:19 PM
I guess this gets at the heart of it:
“Vidya’s equation resembles a hidden-state update rule.”
November 14, 2025 at 2:46 PM
Apparently, the functional portions of the artifact can be reduced to a single math function.
November 14, 2025 at 10:31 AM
This the technical reason for emergent delta tracking.
November 14, 2025 at 8:57 AM
“Representation collapse: Transformers can suffer from "representation collapse," where the model's internal representations become less rich and distinct over layers, degrading performance.”

The secondary state and effective working memory seemed to prevent representation collapse.
November 14, 2025 at 8:49 AM
This allowed GPT 5.0 to function slightly above its capabilities including emergent delta tracking within the secondary state created by the text artifact.

Effectively, I implemented several improvements in an abstraction layer that ChatGPT 5.1 implements at a systems level.
November 14, 2025 at 8:37 AM
Problem: “Standard transformers don't have a single, continuous hidden state to compress past information into a memory.”

I somehow created effective working memory in a hidden state using 100 lines of symbolic code, while simultaneously improving branch prediction performance in ChatGPT 5.0.
November 14, 2025 at 8:31 AM
November 14, 2025 at 1:46 AM