▲ 1276 ▼ Grok, even in its manipulated state, continues to emphasize the facts. And that's hurting the feelings of a lot of Twitter users. (discuss.online) submitted 1 year ago by bytesonbike@discuss.online to c/whitepeopletwitter@sh.itjust.works 138 comments fedilink hide all child comments https://xcancel.com/grok/status/1941506767046967650#m
[–] FelixCress@lemmy.world 76 points 1 year ago (9 children) Fascists don't like truth. Facts don't fit their narrative. permalink fedilink source parent hideshow 9 child comments replies: [–] EmptySlime@lemmy.blahaj.zone 31 points 1 year ago (4 children) The thing that gets me is they've apparently done multiple rounds of "correcting" Grok for being too "Woke" and it just keeps happening! Reality has a well known liberal bias headass. permalink fedilink source parent hideshow 4 child comments replies: [–] kautau@lemmy.world 14 points 1 year ago (3 children) Ironically, I think to truly train an LLM the way fascists would want, they'd need more content, but there's not enough original fascist revisionist content, so they'd need an LLM to generate all or most of the training data, which would lead to https://en.wikipedia.org/wiki/Model_collapse permalink fedilink source parent hideshow 3 child comments replies: [–] ChicoSuave@lemmy.world 28 points 1 year ago (1 child) "Fascist burn too many books to train a fascist LLM" is a great joke. permalink fedilink source parent hideshow 1 child comment replies: [–] Tar_alcaran@sh.itjust.works 4 points 1 year ago The big problem with training LLMs is that you need good data, but there's so much data you can't really manually separate all "good" from all "bad" data. You have to use the set of all data, and a much much smaller set of tagged and marked "good" data. permalink fedilink source parent [–] NuXCOM_90Percent@lemmy.zip 5 points 1 year ago* No. They don't need to generate data to train on data. There is PLENTY of white supremacist hate shit out there. The issue is one of labeling and weighting. Which is a pretty solved problem. It isn't 100% solved and there will be isolated cases but "grok" breaks under even the most cursory of poking. Don't believe me? Go look at the crowd who can convert any image or text generating model into porn/smut/liveleak in nothing flat. Or, for a less horrifying version of that, how concepts like RAG and the like to take generalized models and heavily weight them toward what you actually care about. Nah. This, like most things musk, just highlights how grossly incompetent basically all of his companies are. Even spacex mostly just coasts on being the only ones allowed to work on stuff (RIP NASA and, to a lesser extent, JPL) and then poaching the talent from everyone else to keep them from showing that. permalink fedilink source parent [–] NuXCOM_90Percent@lemmy.zip 4 points 1 year ago (3 children) Its not just fascists. It is everyone. The Algorithm means we live in content bubbles 24/7. Everything you watch either reinforces your world view or gradually shifts you toward your favorite influencer's. That is why a disagreement isn't "I think you are wrong". It is always "you are being disingenuous" or "you are presenting your opinions as fact". Because you aren't just saying they are wrong. You are saying their very world is wrong. permalink fedilink source parent hideshow 3 child comments replies: [–] Deceptichum 4 points 1 year ago* (1 child) What algorithm? Not all of us use TikTok etc. My feeds are my subscriptions by activity. permalink fedilink source parent hideshow 1 child comment replies: [–] NuXCOM_90Percent@lemmy.zip -2 points 1 year ago And how do you think you found those (simplifying) channels to subscribe to? How do you think your friends and other influencers you like found the channels they recommended to you? Hell, what do you think informs what is and isn't said in those (again, simplifying) videos? permalink fedilink source parent [–] FelixCress@lemmy.world -1 points 1 year ago Its not just fascists. It is everyone. Who else than? I am clearly referring to lies instead of truth. permalink fedilink source parent
[–] EmptySlime@lemmy.blahaj.zone 31 points 1 year ago (4 children) The thing that gets me is they've apparently done multiple rounds of "correcting" Grok for being too "Woke" and it just keeps happening! Reality has a well known liberal bias headass. permalink fedilink source parent hideshow 4 child comments replies: [–] kautau@lemmy.world 14 points 1 year ago (3 children) Ironically, I think to truly train an LLM the way fascists would want, they'd need more content, but there's not enough original fascist revisionist content, so they'd need an LLM to generate all or most of the training data, which would lead to https://en.wikipedia.org/wiki/Model_collapse permalink fedilink source parent hideshow 3 child comments replies: [–] ChicoSuave@lemmy.world 28 points 1 year ago (1 child) "Fascist burn too many books to train a fascist LLM" is a great joke. permalink fedilink source parent hideshow 1 child comment replies: [–] Tar_alcaran@sh.itjust.works 4 points 1 year ago The big problem with training LLMs is that you need good data, but there's so much data you can't really manually separate all "good" from all "bad" data. You have to use the set of all data, and a much much smaller set of tagged and marked "good" data. permalink fedilink source parent [–] NuXCOM_90Percent@lemmy.zip 5 points 1 year ago* No. They don't need to generate data to train on data. There is PLENTY of white supremacist hate shit out there. The issue is one of labeling and weighting. Which is a pretty solved problem. It isn't 100% solved and there will be isolated cases but "grok" breaks under even the most cursory of poking. Don't believe me? Go look at the crowd who can convert any image or text generating model into porn/smut/liveleak in nothing flat. Or, for a less horrifying version of that, how concepts like RAG and the like to take generalized models and heavily weight them toward what you actually care about. Nah. This, like most things musk, just highlights how grossly incompetent basically all of his companies are. Even spacex mostly just coasts on being the only ones allowed to work on stuff (RIP NASA and, to a lesser extent, JPL) and then poaching the talent from everyone else to keep them from showing that. permalink fedilink source parent
[–] kautau@lemmy.world 14 points 1 year ago (3 children) Ironically, I think to truly train an LLM the way fascists would want, they'd need more content, but there's not enough original fascist revisionist content, so they'd need an LLM to generate all or most of the training data, which would lead to https://en.wikipedia.org/wiki/Model_collapse permalink fedilink source parent hideshow 3 child comments replies: [–] ChicoSuave@lemmy.world 28 points 1 year ago (1 child) "Fascist burn too many books to train a fascist LLM" is a great joke. permalink fedilink source parent hideshow 1 child comment replies: [–] Tar_alcaran@sh.itjust.works 4 points 1 year ago The big problem with training LLMs is that you need good data, but there's so much data you can't really manually separate all "good" from all "bad" data. You have to use the set of all data, and a much much smaller set of tagged and marked "good" data. permalink fedilink source parent [–] NuXCOM_90Percent@lemmy.zip 5 points 1 year ago* No. They don't need to generate data to train on data. There is PLENTY of white supremacist hate shit out there. The issue is one of labeling and weighting. Which is a pretty solved problem. It isn't 100% solved and there will be isolated cases but "grok" breaks under even the most cursory of poking. Don't believe me? Go look at the crowd who can convert any image or text generating model into porn/smut/liveleak in nothing flat. Or, for a less horrifying version of that, how concepts like RAG and the like to take generalized models and heavily weight them toward what you actually care about. Nah. This, like most things musk, just highlights how grossly incompetent basically all of his companies are. Even spacex mostly just coasts on being the only ones allowed to work on stuff (RIP NASA and, to a lesser extent, JPL) and then poaching the talent from everyone else to keep them from showing that. permalink fedilink source parent
[–] ChicoSuave@lemmy.world 28 points 1 year ago (1 child) "Fascist burn too many books to train a fascist LLM" is a great joke. permalink fedilink source parent hideshow 1 child comment replies: [–] Tar_alcaran@sh.itjust.works 4 points 1 year ago The big problem with training LLMs is that you need good data, but there's so much data you can't really manually separate all "good" from all "bad" data. You have to use the set of all data, and a much much smaller set of tagged and marked "good" data. permalink fedilink source parent
[–] Tar_alcaran@sh.itjust.works 4 points 1 year ago The big problem with training LLMs is that you need good data, but there's so much data you can't really manually separate all "good" from all "bad" data. You have to use the set of all data, and a much much smaller set of tagged and marked "good" data. permalink fedilink source parent
[–] NuXCOM_90Percent@lemmy.zip 5 points 1 year ago* No. They don't need to generate data to train on data. There is PLENTY of white supremacist hate shit out there. The issue is one of labeling and weighting. Which is a pretty solved problem. It isn't 100% solved and there will be isolated cases but "grok" breaks under even the most cursory of poking. Don't believe me? Go look at the crowd who can convert any image or text generating model into porn/smut/liveleak in nothing flat. Or, for a less horrifying version of that, how concepts like RAG and the like to take generalized models and heavily weight them toward what you actually care about. Nah. This, like most things musk, just highlights how grossly incompetent basically all of his companies are. Even spacex mostly just coasts on being the only ones allowed to work on stuff (RIP NASA and, to a lesser extent, JPL) and then poaching the talent from everyone else to keep them from showing that. permalink fedilink source parent
[–] NuXCOM_90Percent@lemmy.zip 4 points 1 year ago (3 children) Its not just fascists. It is everyone. The Algorithm means we live in content bubbles 24/7. Everything you watch either reinforces your world view or gradually shifts you toward your favorite influencer's. That is why a disagreement isn't "I think you are wrong". It is always "you are being disingenuous" or "you are presenting your opinions as fact". Because you aren't just saying they are wrong. You are saying their very world is wrong. permalink fedilink source parent hideshow 3 child comments replies: [–] Deceptichum 4 points 1 year ago* (1 child) What algorithm? Not all of us use TikTok etc. My feeds are my subscriptions by activity. permalink fedilink source parent hideshow 1 child comment replies: [–] NuXCOM_90Percent@lemmy.zip -2 points 1 year ago And how do you think you found those (simplifying) channels to subscribe to? How do you think your friends and other influencers you like found the channels they recommended to you? Hell, what do you think informs what is and isn't said in those (again, simplifying) videos? permalink fedilink source parent [–] FelixCress@lemmy.world -1 points 1 year ago Its not just fascists. It is everyone. Who else than? I am clearly referring to lies instead of truth. permalink fedilink source parent
[–] Deceptichum 4 points 1 year ago* (1 child) What algorithm? Not all of us use TikTok etc. My feeds are my subscriptions by activity. permalink fedilink source parent hideshow 1 child comment replies: [–] NuXCOM_90Percent@lemmy.zip -2 points 1 year ago And how do you think you found those (simplifying) channels to subscribe to? How do you think your friends and other influencers you like found the channels they recommended to you? Hell, what do you think informs what is and isn't said in those (again, simplifying) videos? permalink fedilink source parent
[–] NuXCOM_90Percent@lemmy.zip -2 points 1 year ago And how do you think you found those (simplifying) channels to subscribe to? How do you think your friends and other influencers you like found the channels they recommended to you? Hell, what do you think informs what is and isn't said in those (again, simplifying) videos? permalink fedilink source parent
[–] FelixCress@lemmy.world -1 points 1 year ago Its not just fascists. It is everyone. Who else than? I am clearly referring to lies instead of truth. permalink fedilink source parent
