Lightnews — Scholar-powered news

LightNews

Luke Marsden

@lmarsden.bsky.social

2.5K followers 4.5K following 81 posts

Hacker & entrepreneur. Founder helix.ml, private GenAI stack, getting business value out of local open source LLMs

Posts Media Videos Starter Packs

Luke Marsden @lmarsden.bsky.social · Aug 1

Bootstrapped a Private GenAI Startup to $1M revenue, AMA

blog.helix.ml/p/bootstrapp...

Bootstrapped Private GenAI Startup Hits $1M Annual Revenue, Launches Helix 2.0

The people behind the story, how agentic AI is changing and why we don't want a sales call with you

Luke Marsden @lmarsden.bsky.social · Apr 3

Thanks Hannah! 💖

Hannah Foxwell @hannahfoxwell.net · Apr 2

Always a good sign when the speakers are mobbed after their talk! Well done @lmarsden.bsky.social and Priya - smashed it! #kubecon #cloudnativecon

Luke Marsden @lmarsden.bsky.social · Apr 3

Good morning #KubeCon! Come find me if you want to talk running LLM systems like vision RAG in production on Kubernetes today. Email [email protected] or reply here!

Luke Marsden @lmarsden.bsky.social · Apr 2

Phil setting up a vLLM vision model provider on helix on his nerd phone on the Elizabeth line #kubecon

Luke Marsden @lmarsden.bsky.social · Apr 2

I mean, yes please 😄

Luke Marsden @lmarsden.bsky.social · Apr 2

Catch my talk with Priya Samuel on running LLMs in production on k8s today at #KubeCon at S10A at 3:15pm ✨

Luke Marsden @lmarsden.bsky.social · Apr 2

Trying (but failing) to be as colourful as @hannahfoxwell.net today!

Luke Marsden @lmarsden.bsky.social · Apr 2

Trying (but failing) to be as colourful as @hannahfoxwell.net today!

Reposted by Luke Marsden

HelixML @helixml.bsky.social · Apr 1

Oh hello there BlueSky! We've arrived here just in time to share all the highlights of #KubeCon #CloudNativeCon in sunny London!

Don't miss @hannahfoxwell.net and @lmarsden.bsky.social at 15:20 today talking about Platform Engineering and Developer Experience For Your On Prem LLM

Reposted by Luke Marsden

Jennifer Riggins @jkriggins.bsky.social · Feb 20

I looked to define a term that’s being thrown around — #AI-native developer — with the help of @guypo.com @lmarsden.bsky.social and Thoughtworks’ Mike Mason so you can prepare your software teams for the near future.
thenewstack.io/what-is-an-a...
What’s your definition? Only on @thenewstack.io

What Is an AI Native Developer?

We explain what an AI native developer is, how the role will evolve, and why spec-driven AI development is driving this trend.

Luke Marsden @lmarsden.bsky.social · Feb 20

Based on my experience of riding the crazy horse that is cursor agent mode, spec-driven development is much needed!

Luke Marsden @lmarsden.bsky.social · Jan 30

blog.helix.ml/p/you-should...

You should run local models: run Deepseek-R1 on Helix 1.5.0 now

Chinese Hedge Fund crashes US stock market by releasing Deepseek-R1, and what this means for your enterprise GenAI strategy

Luke Marsden @lmarsden.bsky.social · Jan 30

Deepseek are clever fuckers. I wrote this about how Deepseek is pushing decision makers in large financial institutions to seriously consider running their own models instead of calling out to Microsoft, Amazon & Google

Link below 👇

Reposted by Luke Marsden

OpenUK @openuk.bsky.social · Jan 15

Speaker @lmarsden.bsky.social of MLOps Consulting will be in our SOOCon25 AI Openness track! 🎤 Join to hear about Production-Ready LLMs on Kubernetes: Patterns, Pitfalls, and Performance.💡https://buff.ly/3HjeQxq
#opensource #opensourceai #ai #stateofopencon #soocon25 #opensourcelondon #openuk

Reposted by Luke Marsden

Martin Paul Eve @eve.gd · Jan 12

I enjoyed Stories of Your Life and Others so much that I'm moving straight to Chiang's other collection: Exhalation.

The cover of Ted Chiang's Exhalation. It shows a pair of lungs made up by plants and gears/cogs.

Luke Marsden @lmarsden.bsky.social · Jan 8

MS Teams in the UK this morning is the most grim experience imaginable, tons of jitter and bandwidth seems fucked - like trying to do a video call over a highly contended LTE connection - my network connection is fine (per mtr) - is there an outage in some MS data center somewhere?

Luke Marsden @lmarsden.bsky.social · Jan 6

We shipped a lot over Christmas and I came here to release it:

github.com/helixml/heli...

- You can now drag'n'drop files directly into knowledge for Helix apps (rather than having to go via the filestore).

- Initial support for MCP (more on this coming soon!)

Release 1.4.12 - apps drag'n'drop filestore, initial MCP support · helixml/helix

What's Changed make frontend work better with filestore knowledge by @nessie993 in #668 Model Context Protocol (MCP) support by @nessie993 in #680 security/refactoring/quality changes: Revive vo...

Luke Marsden @lmarsden.bsky.social · Jan 3

Cancelled my X subscription over all the stupid political interference

Luke Marsden @lmarsden.bsky.social · Dec 20

Thank you to @dciangot.com for doing the heavy lifting getting HelixML GPU runners running on Slurm HPC infra to take advantage of hundreds of thousands of GPUs running on Slurm infrastructure and transform them into multi-tenant GenAI systems!

Read all about it here: blog.helix.ml/p/running-ge...

Running GenAI on Supercomputers: Bridging HPC and Modern AI Infrastructure

Transform Your Supercomputer into a Private OpenAI: A Look at How Modern HPC Infrastructure Can Power Enterprise AI

Luke Marsden @lmarsden.bsky.social · Dec 20

This is so awesome! Imagine being able to combine the worlds of cloud-native scalable web services for LLMOps with the raw power of Slurm-powered supercomputers with some of the biggest compute power, networking and GPUs! Check out the writeup here: blog.helix.ml/p/running-ge...

Luke Marsden @lmarsden.bsky.social · Dec 19

So @cybernetist.com got gptscript working with llama3.3:70b! Check out the detailed writeup here: blog.helix.ml/p/gptscript-...

GPTScript Helix Apps: For Fun and Profit

Making GPTScript Shine with Open Source LLMs: How Llama 3's 70B Model Finally Makes Natural Language Programming Reliable

Luke Marsden @lmarsden.bsky.social · Dec 13

Got helix.ml running GenAI on a supercomputer..

Private GenAI Platform – HelixML

Build, test and deploy GenAI apps. Connect knowledge and business applications via APIs. Deploy in your cloud or use ours

Luke Marsden @lmarsden.bsky.social · Dec 11

You're a dope llama hacker (ha ha try finding a gif for that)

Luke Marsden @lmarsden.bsky.social · Dec 11

Fucking dope helix.ml release from @cybernetist.com if you like function calling in open source LLMs and @GPTScript_ai github.com/helixml/heli...

(Excuse my French)

Release 1.4.9 - support function calling in helix runners, add gptscript runner · helixml/helix

What's Changed Add gptscript_runner service to helix stack by @milosgajdos in #635 Bump ollama and update LLM inference with Tool calling by @milosgajdos in #637 Full Changelog: 1.4.8...1.4.9

Luke Marsden @lmarsden.bsky.social · Dec 4

Here's the post with the youtube video walkthrough of the workshop in it: blog.helix.ml/p/building-r...

Building Reliable GenAI Applications: A Hands-on Testing & CI Workshop

Recap and a walkthrough video of the Testing & CI for GenAI Workshop we ran yesterday. Join the next one!

Luke Marsden @lmarsden.bsky.social · Dec 4

Test Driven Development (TDD) for your LLMs? Yes please, more of that please!

Back to basics - write a test, see the test fail, improve the prompt, see it pass, check it in - just like you would with any other code 😄