Implemented a tiny transformer-based LLM (~50M params) in PyTorch. Reaching ~34 perplexity after 50k iterations on WikiText-103.

Code: github.com/RobinLmn/tin...

Almost 5x faster convergence with PPO compared to REINFORCE, and a much lower variance. Tested on the CartPole environment.

Code: github.com/RobinLmn/car...

Implemented an Adam optimizer for my small C++ CartPole playground. Environment solved in sub 500 batches, about 10 times faster than with SGD Momentum.

Code: github.com/RobinLmn/car...

How adding momentum to a stochastic gradient descent optimizer affects training performance.

In a CartPole environment using REINFORCE, SGD with momentum averages 490 reward in just 5,000 steps, compared to 292 after 10,000 steps without momentum.

Code: github.com/RobinLmn/car...

First commit by ChatGPT Codex, after asking it to find and fix critical bugs in my repo.

Couldn't have made it without it.

Comparison of different baselines in the REINFORCE algorithm, trained on the CartPole environment (with SGD).

Using a running baseline not only improves overall agent performance, but also reduces reward variance throughout training.

Code: github.com/RobinLmn/car...

Revisiting my undergrad research: a 3D visualization tool for simulating debris disks around solar systems. You can detect hidden exoplanets from their shape. Renders in scattered light and thermal radiation.

🌌 Code: github.com/RobinLmn/deb...

#graphics #rendering #cpp #physics

Playing around with HDR lighting, I implemented ACES tonemapping in my CUDA-raytracer. Definitely gives a more cinematic look, while keeping the colors bright.

Check it out: github.com/RobinLmn/cud...

#cpp #raytracing #graphics #rendering #hdr

Hello, ray-traced triangle! Got slightly bored of looking at spheres all day… Even the tiny bed really hurts performances. I might try implementing a BVH in the future. Maybe @jbikker.bsky.social’s tinyBVH?

Code: github.com/RobinLmn/cud...

#graphics #cpp #rendering #raytracing

Got inspired by @sebastianlague.bsky.social to add anti-aliasing to my CUDA raytracer. Each ray’s direction is jittered slightly within the pixel. Averaging them out reduces jagged edges and noise.

#cuda #cpp #graphics #raytracing #rendering

I’ve been building a basic raytracer in C++ and CUDA. It uses OpenGL-CUDA interop for real-time visual feedback. No CPU transfers, all on the GPU. Progressive rendering makes a big difference.

Check it out: github.com/RobinLmn/cuda-raytracer

#cuda #raytracing #cpp #graphics #rendering