all 2 comments

sorted by: hot top controversial new old
[–] 4 points 1 year ago
[–] 2 points 1 year ago

🤮🤮🤮🤮

  • source
  • 23 comments in c/linux@lemmy.ml view that post
    [–] 47 points 1 year ago

    While I definitely do not want a LLM (especially not Open AI or whatever) to have access to my terminal or other stuff on my PC, and in general don't have any use for that, I find it cool that something like this is available now.

    Remember, it's totally optional and nobody forces you to download that stuff. You have the choice to ignore it, and that's the great thing about Linux!

  • source
  • [–] 55 points 1 year ago

    I look forward to not installing it.

  • source
  • [–] 8 points 1 year ago

    Works with Ollama, neat!

  • source
  • [–] 14 points 1 year ago

    holy shit, no thank you

  • source
  • [–] 7 points 1 year ago*

    From the title I thought Gnome foundation made a Ai Client for a sec, Until I read the article.

  • source
  • [–] 8 points 1 year ago

    Big nope from me dawg

  • source
  • [–] 11 points 1 year ago (3 children)

    Or, ORRRR....just do the stuff yourself and don't further perpetuate this dumbshit until it doesn't require an entire months worth of energy for an efficient home to run to search "Hentai Alien Tentacle Porn" for you.

    Buncha savages.

  • source
  • hideshow 3 child comments
  • [–] 5 points 1 year ago (4 children)

    For some reason, these local LLMS are straight up stupid. I tried deepseek R1 through ollama and it was straight up stupid and gave everything wrong. Anyone got the same results? I did the 7b and 14b (if I remember these numbers correctly), 32 straight up didn't install because I didn't have enough RAM.

  • source
  • hideshow 4 child comments
  • [–] 9 points 1 year ago

    Did you use a heavily quantized version? Those models are much smaller than the state of the art ones to begin with, and if you chop their weights from float16 to float2 or something it reduces their capabilities a lot more

  • source
  • parent
  • [–] 2 points 1 year ago*

    I've had good experience with smollm2:135m. The test case I used was determining why an HTTP request from one system was not received by another system. In total, there are 10 DB tables it must examine not only for logging but for configuration to understand if/how the request should be processed or blocked. Some of those were mapping tables designed such that table B must be used to join table A to table C, table D must be used to join table C to table E. Therefore I have a path to traverse a complete configuration set (table A <-> table E).

    I had to describe each field being pulled (~150 fields total), but it was able to determine the correct reason for the request failure. The only issue I've had was a separate incident using a different LLM when I tried to use AI to generate golang template code for a database library I was wanting to use. It didn't use it and recommended a different library. When instructed that it must use this specific library, it refused (politely). That caught me off-guard. I shouldn't have to create a scenario where the AI goes to jail if it fails to use something. I should just have to provide the instruction and, if that instruction is reasonable, await output.

  • source
  • parent
  • [–] 4 points 1 year ago* (7 children)

    I haven't tested this but TBH as someone who has run Linux at home for 25 years I love the idea of an always alert sysadmin keeping my machine maintained and configured to my specs. Keep my IDS up to date. And so on.

    Two requirements:

    1 Be an open source local model with no telemetry

    2 Let me review proposed changes to my system and explain why they should be made

  • source
  • hideshow 7 child comments
  • [–] 6 points 1 year ago (2 children)

    Like what do you need to keep configured? lol Linux is set it and forget it. I’ve had installs be fine from day one to year 7. It’s not like windows where Microsoft is constantly changing things and changing your settings. Like it takes minimum effort to keep a Linux server/system going after initial configuration.

  • source
  • parent
  • hideshow 2 child comments
  • [–] 1 point 1 year ago

    Do you use IDCS? If not, why not? Have you taken care of automating encryption and backup to cloud? There's a new open source shared media server, are you interested in configuring, securing, and testing it?

    It's mostly set and forget, Earth is mostly harmless, etc

  • source
  • parent
  • [–] 2 points 1 year ago

    You could use AI for self-healing network infrastructure, but in the context of what this tool would do, I'm struggling. You could monitor logs or IDS/IPS, but you'd really just be replacing a solution that already exists (SNMP). And yeah, SNMP isn't going to be pattern matching, but your IDS would already be doing that. You don't need your traffic pattern matching system pattern matched by AI.

  • source
  • parent
  • [–] 4 points 1 year ago* (2 children)

    Even if it was open source (it isn't, because no model is really open source ultimately) and even if it let you review what it says it's gonna do, AI is known for pulling all kinds of shit and lie about it.

    Would you really trust your system to something that can do this? I wouldn't...

  • source
  • parent
  • hideshow 2 child comments
  • [–] 6 points 1 year ago*

    Would you really trust your system to something that can do this? I wouldn't...

    I wouldn't trust a Sales team member with database permissions, either. This is why we have access control in sysadmin. That AI had permission to operate as the user in Replit's cloud environment. Not a separate restricted user, but as that user and without sandboxing. That should never happen. So, if I were managing that environment I would have to ask the question: is it the AI's fault for breaking it or is it my fault for allowing the AI to break it?

    AI is known for pulling all kinds of shit and lie about it.

    So are interns. I don't think you can hate the tool for it being misused, but you certainly can hate the user for allowing it.

  • source
  • parent
  • 7 comments in c/linux@programming.dev view that post
    [–] 14 points 1 year ago (5 children)

    Huh???? Are they going to bring AI to the Gnome desktop ? Because that's exactly what I was running from.

  • source
  • hideshow 5 child comments
  • [–] 6 points 1 year ago (2 children)

    Currently it’s a third party application for Gnome.

  • source
  • parent
  • hideshow 2 child comments
  • [–] 1 point 1 year ago (1 child)

    Yeah, but don't they tend to incorporate any apps in the GNOME desktop if they deem it worthy? Or think that it'll improve the experience, or compete against other desktops like Mac or Windows?

  • source
  • parent
  • hideshow 1 child comment
  • [–] 4 points 1 year ago

    Yeah, but don’t they tend to incorporate any apps in the GNOME desktop if they deem it worthy?

    If there is mutual consensus to join forces, yes. I'm very critical of Gnome and their UX demands but in this case I don't think Newelle as any chance to be mainlined into Gnome without some changes. I don't think Gnome developers would be interested in an AI assistant that connects to Google and OpenAI. https://raw.githubusercontent.com/qwersyk/Newelle/master/screenshots/3b.png

  • source
  • parent
  • [–] 4 points 1 year ago

    God damn it, linux distros is where i go to get away from AI

  • source