[–] 1 point 4 months ago (2 children)

From what I've read, it seems like a lot of the companies monitor API calls and will posion responses for suspicious traffic. This basically means they'll modify the output to be harmful to the scrapper.

Outside of that they can block accounts/IPs, limit what is returned (just the final answer vs all reasoning steps, etc.). However it's a bit like all cyber security and an evolving game of cat and mouse.

  • source
  • parent
  • context
  • [–] 1 point 4 months ago (4 children)

    Its believed (probably more just fact) that a lot of the open source models leverage larger models. Either directly through distiallation (meaning training a model directly off of another) or by using the larger models for knowledge distiallation (basically using the larger models as "ground truth" for training workflows).

    Either way, this means the open source models would always be "a few months behind" as they rely on the progress of the closed source models to improve themselves.

  • source
  • parent
  • context
  • [–] 0 points 4 months ago* (7 children)

    Deepseek and Qwen are catching up fast and at this point in the race it doesn’t matter so much if it takes weeks or even months to catch up to whatever the US releases, but cost is definitely starting to play a much bigger role. Neither country is close enough to AGI yet.

  • source
  • [–] 1 point 4 months ago

    Yeah this is an interesting way to compose the ensemble though. Rather than averaging over sub-networks they're synthesizing the panel of responses:

    A judge model reads every panel response and produces structured analysis: consensus points, contradictions, partial coverage, unique insights, blind spots

    Whereas beam search injects variance by trialling candidate sentences and mixture of experts has competing sub-models here we're reconciling different ideas.

    Notice though that they're always using Opus 4.8 as the judge so I think the claim (of surpassing frontier models) is over-inflated. I'd instead characterise it as outsourcing legwork to cheaper models.

    I'm still optimistic about ensembles of smaller models though. You could imagine a specialist synthesis model or advantages from combining latent activations instead of text responses

  • source
  • parent
  • context
  • [–] 5 points 4 months ago (1 child)

    As an ML Acolyte, Even I can tell that it's a well known phenomenon that ensemble methods are more resilient to overfitting issues. What's fascinating is humanity's penchant to forget the past and rediscover stuff.

  • source
  • [–] 1 point 4 months ago*

    “Significant productivity in the economy is going to raise the standard of living,” he said. “People who today have two-earner households, they’ll become one-earner households. Maybe some people who are working overtime will stop working overtime.”

    Yea this will never happen with you greedy fucks trying to minimize labor cost as much as possible. You are more like to use AI as leverage to pay people less than to allow them to work less for the same income.

  • source
  • [–] 2 points 5 months ago

    I wonder from what angle they are coming at this. Is it the reasonable "a team of experts with sufficient experimental capacity can now prototype potent biological weapons much faster, even though they still have to test them" or is it the wackadoo "you can ask an LLM how to creat a bioweapon and it will list you all the steps".

    The first one, yeah, sure but bad actors (including US) will always try to use any technology for such leverage. If second one, then it is a weak attempt at securing more funding.

  • source
  • [–] 4 points 5 months ago

    For LLMs: For the most part, yes. However, an agentic loop, a sufficient knowledge base about chemicals & reactions, and some simulation tools to help judge, can come up with a top 5 promising solutions/approaches, which can then be tested in a lab. Faking what scientists might try themselves, just faster.

    Then there are the non-LLM specialty AI models, which are increasingly being developed. Probably developed and trained by a small team of domain experts with the help of a coding agent, and seeded with domain-specific datasets.

    The times ARE changing, but I would not expect Little Johnny to be whipping up bioweapons with chatbots anytime soon.

  • source
  • parent
  • context
  • [–] 4 points 5 months ago (2 children)

    What? It's not out here reasoning about chemistry. If the chatbot can tell you how to manufacture anthrax, it's because some Geocities page has the same information for similar searches.

  • source
  • view more: ‹ prev next ›