Here's a little WebXR/LLM experiment, inspired by two talks at @frontmania.bsky.social about "Built-in AI" (by @rowdy.codes) and "A11y and AI" (by Elga de Klerk).

The concept is a narrator that can explain what the user is seeing, using Gemini Nano on the device itself.

#WebXR #accessibility

... that's it. lost all faith in AI. Was a fun little hype thing, but ready to move on now.

And back in the Netherlands. Have to give another shout-out to @cityjsconf.bsky.social for giving me a good excuse to take the train to London, explore the city for a day, and getting so inspired that I'm now sleep deprived from hacking away last night.

Hoping to do it again next year.

And off we go at London @cityjsconf.bsky.social. Had a great day walking through the city yesterday, now onto Javascript

Have to admit that I had written this off, so was happily surprised when it arrived this morning.

Expectations aren't too high, but I wouldn't mind having a headset specifically for development.

To my complete and utter surprise, there is a VR game based on Foundation(the novels, not the TV show). It's easily one of my favorite sci-fi series, I just hadn't expected to ever see a game released about it, let alone in VR.

First impressions over the weekend were good. Very Telltale-esque.

My first little #LLM powered project.

* It retrieves the last 50 items from my RSS reader
* Next, llama-3:3B is used to create a summary of the article.
* The result is then converted to audio using piper.
* All done on self-hosted hardware.

Perfect to listen to while walking the dogs.

Added a Nvidia Jetson Orin Nano to my home lab for some AI tinkering. Pretty slick hardware, I'm impressed with what it can do on such a small device with so little power.

Was already chatting with it this morning during my commute on how to setup an audio project I intend to use it for.

Recorded some footage of my Nethack VR project.

My main focus is to keep it as close to the original, but did end up adding attack animations for clarity.

Would love feedback on how it looks and feels. Is it clear what I'm going for? Does it look right? And would you expect audio?

Post a ship that's neither Star Wars nor Star Trek

Here's the first one I'm rounding off. It's the original Rogue, but in VR, ascii graphics and all. Personal challenge here is building it in pure vanilla Javascript.

My expectations are that I can't see people playing this for a long time, but my aim is to get some smiles at least.

#webxr #rogue