More pytorch paper replicating.
I didn't know you could use Conv2d for creating patches. Seems obvious now
Next up - Class and positional embeddings!
More pytorch paper replicating.
I didn't know you could use Conv2d for creating patches. Seems obvious now
Next up - Class and positional embeddings!
I'm working on fitting some scripts to an existing codebase. Making a mind map of the important areas helped give an idea of how I can implement this naturally while keeping considerations of the current architecture.
I should start doing this more for projects with lots of moving pieces.
I'm working on fitting some scripts to an existing codebase. Making a mind map of the important areas helped give an idea of how I can implement this naturally while keeping considerations of the current architecture.
I should start doing this more for projects with lots of moving pieces.
I am working my way through PyTorch Zero to Hero Course. On Chapter 8 - Replicating Papers. The difficulty seems to have ramped up quite a bit.
The math is tricky. I don't know if I'm making too many abstractions or not enough...
I've sorted out the patching next calculate embeddings!
I am working my way through PyTorch Zero to Hero Course. On Chapter 8 - Replicating Papers. The difficulty seems to have ramped up quite a bit.
The math is tricky. I don't know if I'm making too many abstractions or not enough...
I've sorted out the patching next calculate embeddings!
I’ve tried many times. But its never stuck. Reading felt like a chore.
I just needed to prove to myself that I can enjoy reading and that I’m just overstimulated. I’ve been going strong currently reading Dark Matter.
I’ve tried many times. But its never stuck. Reading felt like a chore.
I just needed to prove to myself that I can enjoy reading and that I’m just overstimulated. I’ve been going strong currently reading Dark Matter.
I randomly remembered from high school that my teachers would make me write WWW(what went well) and EBI(even better if) after every exam.
Now I write this everyday after work. I am improving. I just get caught up with what I don't know.
I randomly remembered from high school that my teachers would make me write WWW(what went well) and EBI(even better if) after every exam.
Now I write this everyday after work. I am improving. I just get caught up with what I don't know.