I wanted to share with you all my experience on coding with AI, on a self-hosted oss.

This entire post has been fully written by me without any AI.

Edit: I violated rule 4, so I cut the long text here, please read it on the linked blog post!

Also, to be clear, the post itself has no ads and no monetization whatsoever. This is not self promotion for any scope than to share my experience on a controversial topic.

all 29 comments

sorted by: hot top controversial new old
[–] 12 points 3 days ago (1 child)

Rule 4

Don’t duplicate the full text of your blog or readme if you’re providing a link.

  • source
  • hideshow 1 child comment
  • [–] 18 points 3 days ago*

    Biggest issue with LLM "AI" that most people like to ignore is that all current models are created with extremely unethically practices like using unauthorized data, pollution, causing people to go without power for heat/cooling/food refrigeration/etc. due to power demands, etc. Regardless of how ethically/responsibly you might use the technology, the models are not ethical to use. Sure most software has a lot of ethics issues, but LLM model generation is extreme.

  • source
  • [–] 6 points 3 days ago (5 children)

    Did codeberg not make a rule against LLM assisted sodtware recently?

  • source
  • hideshow 5 child comments
  • Here's the blog post from Codeberg regarding their stance on AI/LLM usage:
    https://blog.codeberg.org/protecting-our-floss-commons-from-llms.html

    And at the very bottom:

    However, we also need to be honest about certain use cases that might no longer be welcome on Codeberg. If you see yourself on this list, you don't need to move right away, but there might be other places that better fit your needs:

    Projects that are created by LLM "agents" in autonomous ways
    Projects written and maintained with heavy use of LLMs
    Projects where the amount of resources (e.g. storage, CI/CD) is significantly larger than what the involved amount of people could have created by hand
    Projects heavily tied to the LLM ecosystem, e.g. LLM-written tools to ease LLM usage
    Users sending LLM contributions in violation of project's custom policies
    
  • source
  • parent
  • [–] [S] 3 points 3 days ago (3 children)

    LazyNVR was started without any AI assistance.... Both use of ai and the rule came afterward.

  • source
  • parent
  • hideshow 3 child comments
  • [–] 2 points 2 days ago* (last edited 1 day ago) (2 children)

    Also codeberg did not have a clear cut "no AI policy" (yet). The current informal policy only explicitly forbid project when the AI use causes significant storage cost, abnormal development pattern, or only exist to facilitate LLM usage.

    For example, I think small AI experiment on mostly hand written codebase or AI validation of handwritten code are still allowed on codeberg.

  • source
  • parent
  • hideshow 2 child comments
  • [–] 3 points 3 days ago

    Thanks for sharing

  • source
  • [–] 7 points 3 days ago (8 children)

    a custom software

    "Software" and other "mass" nouns don't get an article like that.

    • a software product
    • an application
    • software (no article)

    You gotta pick a lane.

  • source
  • hideshow 8 child comments
  • [–] [S] 8 points 3 days ago (7 children)

    I am not native English speaker, thanks for the correction.

  • source
  • parent
  • hideshow 7 child comments
  • [–] 3 points 3 days ago (5 children)

    This guy's being pedantic. I say "a software" all the time.

    It's important to understand how a language works, but don't let grammar Nazis trick you into caring about minor rules even English speakers ignore.

  • source
  • parent
  • hideshow 5 child comments
  • [–] 2 points 2 days ago (3 children)

    It won't kill a man but it's still incorrect syntax and a faux pas, it's fine if you're fine with that, but that doesn't make it standard.

    Also it's not really new information that international speakers speak English better than natives, just look at all the "their" "they're" confusion that happens when someone learned English as a native but not when they go through the whole shebang of learning about possessives and articles, so just because a native English speaker ignores a rule in their own language that doesn't really speak much about the language, it says more about the speaker.

  • source
  • parent
  • hideshow 3 child comments
  • [–] 0 points 2 days ago (2 children)

    just because a native English speaker ignores a rule in their own language that doesn't really speak much about the language, it says more about the speaker

    It doesn't. If the speakers of a language ignore a "rule", that says more about the rule itself. Eventually, a rule like the one we're discussing will cease to exist since it only complicates communication, as has happened to past rules and words.

    I also have an issue with calling it "standard". "Standard" is whatever everyone uses. Following rules that no one else does makes you sound robotic. It's why so many guides on pronounciation in English fail. They go off of how the word is spelt and ignore how people actually say it.

  • source
  • parent
  • hideshow 2 child comments
  • [–] 1 point 2 days ago (1 child)

    nah bro, I get descriptivism is important and not locking yourself down too hard lets language evolve, but prescriptivism is how we make sure we are still able to communicate with each other clearly without confusion.

  • source
  • parent
  • hideshow 1 child comment
  • [–] -2 points 3 days ago* (last edited 2 days ago) (9 children)

    No point reading something that no one bothered writing.

    Edit: Sorry OP, I should have checked.

  • source
  • hideshow 9 child comments
  • [–] 7 points 3 days ago (4 children)

    It's clearly written by someone who is not a native English speaker. I noticed that in the first paragraph or so.

    Or do you think an LLM would write "...i can finally say i am quite satisfacted"

    This is not to crap on OP, I'm very impressed with their command of English.

  • source
  • parent
  • hideshow 4 child comments
  • [–] [S] 9 points 3 days ago (3 children)

    Thank you! These days it's good not to master English enough to be mistaken for an ai bot

    My mother language is Italian, not English. But I spent some time living in the US so maybe there is that at my advantage.

  • source
  • parent
  • hideshow 3 child comments
  • [–] 1 point 3 days ago (2 children)

    Italian is a beautiful language, probably my favorite one.

    As far as your post is concerned, I'm using qwen 3.8 27B as my main local LLM. I actually do have it push code to a github repo. Mainly because I have no real interest in learning the code it is writing, I've always been a back end and data person and I'm having it write web stuff. One thing I do a little differently is I make sure the model writes documentation up front and then at the end and also any steps it discovers, that it should remember into an MD file. This is so it doesn't make the same mistakes over and over.

    I also make sure it writes instructions for itself(or another model) and I will sometimes have another model check its work.

    I have started implementing long term memory with obsidian as its "second brain". This way I don't have to keep explaining who I am or what we're doing, what machines are available, what my preferences are, etc...

    I think in a few weeks I'll be able to grab my phone and start giving it tasks to do, using Hermes.

    Nice write up. I appreciate you taking the time to share.

  • source
  • parent
  • hideshow 2 child comments
  • [–] [S] 1 point 2 days ago (1 child)

    Can you elaborate on using obsidian as a memory store?

  • source
  • parent
  • hideshow 1 child comment
  • [–] [S] 6 points 3 days ago (2 children)

    Smartpants, you wouldn't have read it either way....

    And I wrote in the first sentences that no ai has been used to write it's it's all my personal salt

  • source
  • parent
  • hideshow 2 child comments
  • 9 comments in c/localllama@sh.itjust.works view that post
    [–] 7 points 3 days ago (1 child)

    my setup is a Ryzen 9 5950X with 64gb DDR4 and two NVIDIA RTX A4000 (32gb VRAM total)

    Unfortunately still needs a massive amount of computation power... 🥴

  • source
  • hideshow 1 child comment
  • [–] [S] 7 points 3 days ago

    Ram is overkill. 32gb maybe even 16gb would be enough. The CPU too, I used to have an Intel i7 from 10 years ago and it worked. Upgraded because that was the cheapest upgrade I could do.

    The GPUs are mandatory, at least to get 30t/s...

  • source
  • parent
  • [–] 7 points 3 days ago

    I know Lemmy hates AI but it is incredibly useful for exactly this kind of thing (among other things). I had a very close friend who died recently who made an extremely niche but extremely deep/amazing website from 1999-2010. With the help of his family, I found archives of his database and web root files. These files were all legacy formats I wasn't even familiar with and his coding style was wild, not just eccentric but showing an actual misunderstanding of some basic concepts that echoed through his code. This is a very extensive site, I couldn't have hoped to resurrect it without months and months of work. Feeding it all to the AI, it took me about two weeks, and it works perfectly. Like my friend hadn't even got it to work like he wanted back in 2010 and I managed to finish it for him with AI's help - and it would not have happened otherwise, because I would not have had the time to dedicate to it.

  • source
  • [–] 2 points 1 day ago (1 child)

    Thank you for sharing.

    I also tried vibe coding with Qwen3.8 (just give it a few lines of what you want, and step away). and you're right, it does... something, but not at all how you want it. (obvious in hindsight)

    Your Step 4 is how I use AI now. I use Deepseek Harness. I don't use a dedicated plan mode, but I do tell it 'let's plan and write a TODO .md for a ', and we discuss ways of implementing something, what libraries we can use, pit-falls, future-proofing etc., and it will write whatever we decide on in a TODO file. Only after each step has been discussed, I tell it to review the TODO and ask me if it has any more questions. Once it's satisfied, I verify what it wrote in the TODO one last time, and when I'm satisfied I tell it to implement the TODO we just planned.

    TODOs work quite well if you make and review them with the model before it implements it.

  • source
  • hideshow 1 child comment
  • [–] 2 points 2 days ago (3 children)

    Very interesting article, thank you.

    From my experiences with paid models at work, tests were especially insidious: I had cases where a seemingly sensible test showed up to not work at all. I was planning to push it but I got curious, and decided to "break" the feature it said it was pretending to verify. Lo and behold, test stays green. I find it especially bad because nobody loves to write tests, even less to review them, it's not easy to make them good, LLM oh so loves to churn them out, and I'm already tired reviewing the main part of the code.

    As for docs, my personal take is that they may not be as good as you think. IMO it's more that we are not taught to write good docs or even to properly care about them. So I claim it's the same JS case here, just you have even less skill to evaluate it than you had with JS. Note, it's not directed at you personally more than anyone else, and I may certainly be wrong, that's just how I feel about the majority of the industry in the area of docs (even pre-AI to a big degree).

    Your article spelled out some things in a nice new way for me, with an interesting new takeaway for me in context of what I want to learn (here I must especially be wary of "AI" as it can help somewhat but can also actively degrade/hinder/derail/anchor), vs. where I don't - but then if I don't do I have skills to evaluate its result and to what degree (e.g. on your example, IMO, c++ high, js medium, docs low). Thank you again!

  • source
  • hideshow 3 child comments
  • 3 comments in c/selfhost@lemmy.ml view that post
    [–] 1 point 2 days ago (2 children)

    Is the blog created by AI, because all I see is a blank white page with nothing on it.

  • source
  • hideshow 2 child comments
  • [+] 0 points 3 days ago