2
Weird inputs in the middle of texts. (lemmy.world)
submitted 10 months ago by to c/perchance@lemmy.world
5 comments fedilink hide all child comments
 

Seen lots of people at the comments section complain about chinese characters, but I got these:

doubling over until his cap nearly slips off. "ableView finally catching on

The Magic Sphere hums on a pedestal woven from licorice ropes, its surface swirling with imprisoned starlight "../static/placeholder.png"../static/placeholder.png"and fractured reflections

Why was the old model even replaced in first place?

all 6 comments

sorted by: hot top controversial new old
[–] 1 point 10 months ago (1 child)

It seems as if this model is clearly showing its flaws. As of yet, no one has figured out what is causing this exactly, could be a glitch, bug, I doubt even justpassing can explain this.

  • permalink
  • fedilink
  • source
  • hideshow 1 child comment
    •
  • [–] 1 point 10 months ago

    ... and I took this personally. 😆

    Jokes aside, what we all are seeing is something akin to the demonstration in this video:

    https://www.youtube.com/shorts/WP5_XJY_P0Q

    A theory of why this happens is because the model can't find a proper way to extrapolate a large large input in a coherent way so it picks random connections causing it to "speak in tongues".

    In the video, the exploit performed is to make the model think it gave as legit advice something outlandish, so it "short circuits" and just gargles random data.

    In the case of perchance... I'd be lying if I say I know exactly why it happens now often while in the past this was rare (mind you all, Llama exhibited this too in very niche cases at 20Mb+ and the current model at release I think at 2Mb+, don't quote me on that, I'm just going from memory), is because again the model is being "hyper-trained" so it fixates only and exclusively on the new training data and not the original data bank it had from fabric. Again, this is just my theory as the opposite could be true, if this model is a "clean" one but with a default language that is not English, it may be struggling with large inputs. Then again I bet more on the earlier given how this model behaved at release compared to today.

    Luckily, the workaround is the same as how to cause this artificially: editing the "tongue speak" out and carry on until the model cannot link random parts of its database. It is extremely annoying, but it is not impossible to deal with unless it gets worse and all inputs cause this. In such case, then the model would be broken beyond repair and I hope we don't get there.

  • permalink
  • fedilink
  • source
  • parent
    • [–] 1 point 10 months ago

    At the moment, there just seem to be a few problems, which can happen. Take a look at my comment on this post. It all happened in less than 24 hours: https://lemmy.world/post/41181133

  • permalink
  • fedilink
  • source
    •
    [+] 1 point 10 months ago* (2 children)
    [deleted]
  • permalink
  • fedilink
  • source
  • hideshow 2 child comments
    •
  • [–] 1 point 10 months ago (1 child)

    I can't agree with anything you said here.

    Ah, the sweet whispers of nostalgia mingling with the smell of roasting meats, incense, and maybe, just maybe, freshly baked bread, a stark contrast to the candles casting shadows on the tapestry, a grim tableau of cobblestone streets. But let’s not get ahead of ourselves… her voice, which was a soothing balm, grew determined as her eyes narrowed to slits, eyes gleaming with mischief and never leaving yours, leaning in to whisper: “let me in”.

    Opposed to our current model? "Her dark eyes narrow—knuckles whitening—plum blossom intensifying—as her nails dig moon crescents into his flesh."

    Suffers from the exact same issues efven if worse.

    Look, I get what you mean, but I used it quite frequently for nigh a year and the old model would absolutely, 100% shit the bed at any task that was even remotely complex, which made prompt engineering an outright fool’s errand at times, so just a hunch, but I presume that had something to do with it.

    Don’t know how to put this politely: thing was dumb as a fook’n rock, is what I’m trying to say.

    I really never ever found this to be the case. If anything the new model is worse at writing out elaborate texts because it cuts off faster.

    Honestly might be just to save money because the new model seems briefer-I don't blame the dev and super appreciate this amazing free tool-but don't stand here and tell us it's somehow better.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 1 child comment
    •
  • [–] 2 points 10 months ago

    I have to agree here. The new model is only marginally better in some areas. Yet it still suffers from:

    1. Overly metaphorical descriptions of useless/non-plot driving environmental objects and phenomena. Still seems to have a hardcoded obsession with smells (Even in dialogue)
    2. Obsession with stage directions. (Knuckles whiten etc.)
    3. Still has a limited pool of names, referentials, examples.

    I also found quite a few problems with dialogue generation

    1. Tweeness and Sentimentality: "Remember when Grandma (Always referred to as a proper noun regardless of relationship to speaker) used to bring us freshly baked cookies to school?"
    2. Gaslighting and Negation: I don't know if this is a personal problem, but the characters seem to be extremely gaslighting (I didn't tell them to be that) and constantly negate my statements with 'Bullshit'. Gets very agitating after a while.
    3. Tries way to hard to be funny and falls completely flat: "This place smells like regret and stale beer." (Two problems in one: obsession with smells and an overused AI trope) Other than that, the dialogue is slightly better and less all-out than the previous model.

    Outside knowledge is satisfactory but not fantastic.

    So yeah, it's better and perfectly fine for a free tool, but not nearly up to ChatGPT levels.

  • permalink
  • fedilink
  • source
  • parent