home - all - feeds - topics | memes - homeassistant - nottheonion - lemmyshitpost - fuckcars - comicstrips - cat - politics - shittyasklemmy - whatisthisthing - technology - curatedtumblr - tenforward - til - nostupidquestions - furry_irl - asklemmy - games - memes - world - more ยป
log in or sign up | preferences |
quokk.au site icon
70k32@sh.itjust.works
  • overview
  • comments
  • submitted
  • 70k32

    70k32@sh.itjust.works
    joined 1 year ago
    sorted by: new top controversial old
    a foos GenAi tool for daily usage in c/opensource@lemmy.ml
    [โ€“] 70k32@sh.itjust.works 1 point 9 months ago

    jan.ai with some local model

  • permalink
  • fedilink
  • source
  • Selfhosted coding assistant? in c/selfhosted@lemmy.world
    [โ€“] 70k32@sh.itjust.works 1 point 9 months ago

    This. Llama.cpp with Vulkan backend running in docker-compose, some Qwen3-Coder quantization from huggingface and pointing Opencode to that local setup with a OpenAI-compatible is working great for me.

  • permalink
  • fedilink
  • source
  • parent
  • context
  • piefed
    0.5.3
    mlmym
    dotzip.1.9
    quokk.au
    modlog