you are viewing a single comment's thread
view the rest of the comments
[–] 20 points 9 months ago (4 children)

I don't know if a lot of people realize that LLM's basically started from Google translate.

  • source
  • hideshow 4 child comments
  • [–] 1 point 9 months ago* (last edited 9 months ago) (2 children)

    I wonder if they connect all the way back to Micro$oft's neo Nazi chat bot from decades ago?

  • source
  • parent
  • hideshow 2 child comments
  • [–] 27 points 9 months ago (1 child)

    Not sure if you really want to know, but a Google paper is where transformers (backbone of LLMs) were first mentioned (2016 I believe). Google initially used transformers for translations and eventually search, but OpenAI experimented with them for text generation (gpt 1+) eventually leading to chatgpt.

  • source
  • parent
  • hideshow 1 child comment