[–] 4 points 2 months ago

Oh this is very interesting to me. I just scrolled through their plugin store and was really into trying those! I am a long time plasma5 kde or i3/sway user... And I am about to distro hop the desktop pc at work, so maybe I'd check something like this on cachyos

  • source
  • [–] [S] 7 points 2 months ago

    yeah, and actually all those platforms have been shown on different opportunities to have a bot problem and it's still unaddressed because it's basically a conflict of interests to them (numbers go up : stakeholders go happy.) That's basically how I've been drown to Lemmy (and before, other 'niche' forums, irc channels, etc.)

  • source
  • parent
  • context
  • [–] 2 points 2 months ago (1 child)

    How about a cloud provider and then taking a open model to that? Also difficult to find, but it's better chance... Hetzner comes to mind. Then you may self-host ollama and some gateway to monitor token usage.

    Even if it came to API key on a asian or american company, self host makes sense to me to relax on the lock in (e.g. Bifrost) and have some management dashboard. There's a growing ecosystem of self-hosted tools, the lates I saw was experientiallabs.ai that was aimed to save costs.

    (6I'm on a similar track tho I am just a 1-man army with lended over pro plans (no apis) setting up omp.sh to combine and decouple tasks among providers and differentially sized models.)

  • source
  • view more: ‹ prev next ›