all 9 comments

sorted by: hot top controversial new old
[–] 8 points 1 year ago

There's also Mistral and Lumo as a non-google private alternative.

  • source
  • [–] 8 points 1 year ago (2 children)

    I don't believe evil Google. Not one bit. Google thrives on data, not privacy.

  • source
  • hideshow 2 child comments
  • [–] 1 point 1 year ago (1 child)

    If you're hosting the model yourself, Google quite literally can't gather any data from its usage. You can turn off/monitor all network usage, it's just not going to happen

  • source
  • parent
  • hideshow 1 child comment
  • [–] 3 points 1 year ago*

    It's pretty rich that Google persists in putting on the charade of caring about privacy.

  • source
  • [–] 2 points 1 year ago (3 children)

    This is really interesting work!

    I feel like the commenters here simply did not read the article. This is a model provided for download to run locally. There is no way for Google to collect data here...

  • source
  • hideshow 3 child comments
  • [–] 1 point 1 year ago (2 children)

    Now this one looks a comment that has never dealt with canary traps for sure.

  • source
  • parent
  • hideshow 2 child comments
  • 7 comments in c/technology@beehaw.org view that post
    [–] 36 points 1 year ago

    Google and privacy in the same sentence... Lol

  • source
  • [–] 21 points 1 year ago

    Privacy preserving? More like avoiding lawsuits due to copyrighted information

  • source
  • [–] 16 points 1 year ago

    'Press x to doubt'

  • source
  • [–] 7 points 1 year ago (1 child)

    LLMs have non-deterministic outputs, meaning you can't exactly predict what they'll say.

    I mean...they can have non-deterministic outputs. There's no requirement for that to be the case.

    It might be desirable in some situations; randomness can be a tactic to help provide variety in a conversation. But it might be very undesirable in others: no matter how many times I ask "What is 1+1?", I usually want the same answer.

  • source
  • hideshow 1 child comment
  • [–] 4 points 1 year ago*

    In theory, it's just an algorithm that will always produce the same output given the exact same inputs. In practice it's nearly impossible to have fully deterministic outputs because of the limited precision and repeatability we get with floating point numbers on GPUs.

  • source
  • parent
  • [–] 1 point 1 year ago

    What does people use a 1b model for?

  • source
  • 1 comment in c/privacy@programming.dev view that post
    [–] 1 point 1 year ago

    The second sychophant canary spewing transpiler. Llama was first.

  • source