So, this goes like this:

Up to yesterday's morning, I was creating this story with total normalcy. As I have lunch and then try to continue it, it just won't generate text. As I'm on my phone, I can't analyze it, so I change to my PC.

Once on my PC, I get to analize it, and this are the results.

It literally just randomly decides not to continue the story. It has no special characters, no odd phrasing, no thing at all that could be messing with the system, and it just won't continue it.

It's not a matter of length, I have longer stories that work just fine.

The system is just not generating text.

I have multiple screenshots and can even upload the story if anyone wants to do a test.

Extra: here's my post on reddit, with a lot more of images detailing the issue

[–] 8 points 8 months ago (1 child)

Hello, with all due respect, AI Story Generator is totally terrible right now.

Right now the model is straight up nonsense, ingoring the whole plotline, outputting texts that has just no correlation to the previous ones, jumping scenes without being told to, or refusing to change a scene and follow the new one, etc. It ignores already existing context and details, also makes characters know things they very clearly should not. A few months ago it worked relatively fine, even with the new AI being sometwhat bad at storytelling, now it's plainly dumb, ignoring the user, and even totally senseless.

  • source
  • [–] 3 points 8 months ago

    Hard agree, text model for AI Story Generator is totally terrible.

    I have stories from years, and right now it's just straight up nonsense, even ingoring the whole plotline or outputting texts that has just no correlation to the previous ones. It jumps scenes without being told to, or totally refuses to change a scene and follow the new one. It ignores context and details, and makes characters know things they very clearly should not. A few months ago it worked relatively fine, even with the new AI being sometwhat bad at storytelling, now it's plain dumb and even senseless.

  • source
  • parent
  • context
  • [–] [S] 1 point 1 year ago

    Those 10 mins I got more story done than in two hours yesterday. And this wasn’t the first time, that’s why I think dev might works on it on certain more or less fixed times.

    Following your own analogy, the problem is: this didn't needed any surgery.

  • source
  • parent
  • context
  • [–] [S] 1 point 1 year ago (2 children)

    Those 10 mins I got more story done than in two hours yesterday. And this wasn’t the first time, that’s why I think dev might works on it on certain more or less fixed times.

    The issue is... I use it always, it helps with my Asperger and ADHD

  • source
  • parent
  • context
  • [–] [S] 1 point 1 year ago

    Patience will be more rewarding than a rollback

    Really, REALLY doubt it. I'm struggling right now to get it to write about alternate history, but not the entire AH, fucking singular dialogs. It hallucinates that the character is drunk and tired when nothing similar was even mentioned, it ignores already written paragraphs and does whatever it wants. It is not getting better, unless you consider stupidization better.

    https://perchance.org/story-ai#data=uup1%3A7c498bf05802fc5b74f5e9eb85becacf.gz

    Here's the story as example.

  • source
  • parent
  • context
  • [–] [S] 1 point 1 year ago (5 children)

    it’s much smarter and doesn’t need me to hold it’s hand for every little detail

    Maybe Im the unluckiest guy ever, but on my end, the AI just hallucinates whatever it wants when I do something with a character. I MUST be actively guiding it to obvious things, and it still just completelly ignores it, something never happened before

  • source
  • parent
  • context
  • [–] 1 point 1 year ago (1 child)

    having done references to politicians and celebrities, it does. Though, some things like historical events seem to be censored. The only difference with the old model in that sense is that the new one knows of things happened more recently, but I'd bet its knowledge ends in 2022 or 23

  • source
  • parent
  • context
  • [–] [S] 1 point 1 year ago (1 child)

    More on-topic, I’ve been testing the new model a lot, writing prompts for it from scratch, and the results are amazing: it can consistently understand complex, structured instructions, so one can more reliably make little ‘programs’ with it, not just narrative stuff. But you have to understand that generators using old prompts will more than likely not work out of the box, you have to tinker with them to get the results you want.

    Being brutally honest, no. The AI just does whatever it wants. How long are your stories? cos the old model used to handle my 300k word long ones with ease (around 2.1MB size as the downloaded JSON), and the new model can't even understand what point of the story it is on. Like it's consistensy ir horibid, it just becomes idiotic after the 50 paragraphs, sometimes even less.

    The whole point of AI-Story-Generator is to be a model capable of creating a long story, and the situation now is: it can't.

  • source
  • parent
  • context
  • [–] -2 points 1 year ago

    THIS!

    Dude, giving context is not useful when the AI straight up ignores it! And for me it's worse, you all mostly use the character chats, I use the story generator and it becomes AWFUL. It gives out senseless phrases, doesn't completes phrases when you use the TAB, interrupts characters each 5 words making non-sense dialogs, completely ignores the context, straight up gives sentenses unrelated to the story, doesn't knows when it's on a dialog and when it's not, can't comprehend an idea when it's plain obvious, doesn't follows the narrative style, lacks any idea of what happened 3 paragraphs ago.

    In the name of god, please give us the old model back. Please.

  • source
  • parent
  • context
  •  

    After having used the new model for over a month, mostly on AI Story Generator, and investigating on the old and new AI models used, I've reached to a conclussion that, in m opinion, makes sense.

    The old model was Llama 2. Llama 2 (and Llama 3) are models feed on books, as in lots of literature. Meta licensed a LOT of them to train the models.

    The new model is Deep Seek, or at least it seems to be so. We'll assume it is, but to be fair, it doesn't changes the argument a lot. DS has an issue, it is trained on normal content, say: internet, some books obviously, interations, etc.

    Now, what's the issue with this?

    Llama is a model that knows WAY better how a story works, having hundreds of them on its dataset and having processed them during its training. DS doesn't, DS is a more generalist model, thought more as an assistant than a story creator.

    For the kind of usage done here, essentially either chatting with characters with AI-Character-Chat or writing a story with AI-Story Generator, the improvement in context and general knowledge DS gives is not worth the decrease in narrative quality, and understanding of story writing. That's not mentioning all the hallucinations, total ignoration of context and prompting, and similar the new model has.

    Llama 2 is a way better option for the kind of usage we have. Yes, we would be lossing some general knowledge. Yes, it may not be the best AI model out there. But it's all things considered, it's a matter of chosing the best option for our use case.

    I understand the dev does all this work alone, and appretiate his effort for it. That's why, as a really active user of this platform and service, I consider the best choice here is to return to the old model.

    If you have some argument more for it, please add it in the comments. Thanks everyone for your time.

    -Lucalis.

    view more: next ›