Yeah so what I’m getting from the description is that this LLM doesn’t generate code, at all.

This feeds HTTP traffic directly to an LLM that is prompted how to respond to those requests.

This isn’t an LLM being served prompts to write code to create an HTTP server; the model’s output IS the HTTP server. The model itself is being the webserver, instead of being an autocomplete for an IDE.

The author seems to acknowledge that “the future where it’s just us and our LLMs and intent, no code and no apps” is “science fiction” but he wanted to see how close we could get with today’s tech.