Sounds like being a project manager for a team of one coder AI, honestly quite depressing. You don't get to do the fun part (coding) or you don't actually get to interact with intelligent human beings (possibly only fun part of a managerial role). The only positive thing you get out of it is basically output (which may become unmaintainable for complex projects in the long run). Sounds like something that only CEOs and people trying to get rich quickly would like.
post
Sounds infuriating honestly. Being more productive at the cost of mental health isn’t something we should be aiming for as a species.
1500 tests is a lot. That doesn't mean anything if the tests aren't testing the right thing.
My experience was that it generates tests for the sake of generating them. Some are good. Many are useless. Without a good understanding of what it's generating, you have no way of knowing which are good and which are useless.
It ended up being faster for me to just learn the testing libraries and write my own tests. That way I was sure every test served a purpose and tested the right thing.
Nice to see someone actually trying it themselves to do their own analysis despite having reservations
My experience with LLMs for coding has been similar. You have to be extremely vigilant, because they can produce very good code but will also miss important things that will cause disasters. It makes you very paranoid with their output, which is probably how you should approach it and is honestly how you should approach any code that you’re writing or getting from somewhere else.
I can’t bring my self to actually use them for generating code like he does in this blog post though. That seems infuriating. I find them useful as a way to query knowledge about stuff that I’m interested in which I then cross reference with documentation and other sources to make sure I understand it.
Sometimes you’re dealing with a particular issue or problem that is very hard to Google for or look up. LLMs are a good starting point to get an understanding of it; even if that understanding could be flawed. I found that it usually points me in the right direction. Though the environmental and ethical implications of using these tools also bother me. Is making my discovery phase for a topic a little bit easier worth the cost of these things?
I don't care if human meat made for tastier, healthier hamburgers, and faster too ; I refuse to eat people for any reason whatsoever.
If you don't see how this relates to AI, maybe you are AI yourself.
Interesting read. Haven't finished it yet (it's late, I'm going to bed) but it's a nice shift from the defacto negativity around LLM's on this platform
i tried that recently with a pretty unique app, it gave a decent outline but just made so many bugs it was worthless… every library it included was outdated… i don’t want to imagine how many security flaws it creates.
i think it’s decent if your project has been done a million times before, otherwise it sucks
all 13 comments