[–] 2 points 4 days ago

OP said they didn't want to support billionaires and data centers

The money used to make zdr requests on openrouter to good models like GLM 5.3 flows into large inference providers like fireworks and baseten

Yes, copy pasting is a terrible way to vibe code. But my point is it's still going to be better than trying to ollama with a 1060 and 16 GB RAM

  • source
  • parent
  • context
  • [–] 6 points 5 days ago (2 children)

    The size and token rates mentioned in this thread for local inference are all going to be exceptionally limited compared to the frontier

    Forget about local inference with your hardware, it's too far behind. 3 years behind in this technology is basically stone age

    What you're looking for is "ZDR" (zero data retention) policies from online providers. There are many options. One powerful model with ZDR you can use is gpt-6 Luna on duck.ai

    Even if you're trying to code, you'll get better mileage copy pasting to and from duck than ollama with your hardware

  • source
  • [–] 0 points 2 months ago

    Interestingly i could never invest the time into nextcloud but I can advocate for trying open models in CLI form for anyone looking for good agentic options

    I'm using pi + tensorx + glm 5.2 with some pretty good results. EU hosted and competitive prices

  • source
  • [–] 1 point 1 year ago

    I don't know the answer but my experience with venture capitalists is that they're everything from absolute buffoons to incredibly data-centric in decision making

    So if Y combinator cares about revenue then I think the answer to your question is no, in aggregate, but that's just a guess based on an assumption of information that I don't actually have

  • source
  • parent
  • context
  • [–] 38 points 1 year ago (7 children)

    Real answer:

    1. Get out of debt
    2. Hold a few months worth of expenses in cash/easy access savings
    3. Maximize any yearly contribution to a tax free savings, investment, or pension account
    4. If there's still more left, open an investment account and buy into a world index fund like IWRD if you're in the UK
  • source
  • view more: next ›