Timeline for AI-generated content is not permitted on Ask Ubuntu
Current License: CC BY-SA 4.0
12 events
| when toggle format | what | by | license | comment | |
|---|---|---|---|---|---|
| Sep 11, 2023 at 11:09 | comment | added | Rishon_JR | Actually looking back at this seems like a good idea, but instead of immediately banning them, give them 3 warnings before banning them. | |
| May 19, 2023 at 23:06 | comment | added | Clonkex | @FranckDernoncourt Judging the correctness of the answers is only possible as an SME. That's the problem. When real people post incorrect answers, they almost always look wrong or low-effort. The problem with AI-generated (or LLM-generated, as you seem to prefer) answers is that they're often indistinguishable from human-generated answers while still being actually wrong. | |
| May 19, 2023 at 21:11 | comment | added | Franck Dernoncourt | @cocomac that's ok, I know the specifics meta.stackexchange.com/a/384625/178179 point taken but I disagree with letting bad users making SE less efficient for good users. | |
| May 19, 2023 at 18:33 | comment | added | cocomac | @FranckDernoncourt Well... there are a ton of SO answers that get posted and are AI-generated. And... it would take a lot of reviewer + mod time to test them for correctness. It is way easier/faster to say "They are banned, and if we catch you (I can't share specifics there, but there are good tools we have to find them), then the mods can give you a suspension" (checking for AI-content is faster and more scalable than testing if it is correct). | |
| May 19, 2023 at 7:48 | comment | added | andrew.46 Mod | @FranckDernoncourt A bit hard to judge whether the ban has had an effect in SO, the only real way would be to stop the ban and see if usage took off. And that would be a foolish gamble. And as for correctness of the AI generated answer: for the most part they do not actually answer the question, certainly the many, many cases I have dealt with on AU have this in common. | |
| May 19, 2023 at 5:48 | comment | added | Franck Dernoncourt | @andrew.46 "the tsunami of AI generated non-answers that is still afflicting Stack Overflow" sounds like the LLM ban didn't prevent the tsunami then? The ban doesn't prevent the posts anyway. It just means that instead of judging the correctness of the answers, one assesses the likelihood of whether the answer was written with a language model. | |
| May 19, 2023 at 5:43 | comment | added | Franck Dernoncourt | @Clonkex "The only way this tool is useful is when a subject matter expert carefully reviews the results" mostly true though some LLMs do provide attributions to some extent such as Bing Chat, where a nonexpert can review the links to check whether they support the LLM output. "Not to mention, if people want an AI-generated answer, they can get it themselves. They come to AU/SE for quality human-written answers.)" I disagree, they come for correct answers, regardless of who or what wrote it. And they can't directly use an LLM for that currently due to the inaccuracies of existing LLMs. | |
| May 19, 2023 at 4:41 | comment | added | Clonkex | When the tools are routinely wrong but look correct (or at least highly plausible), they're just not useful. The only way this tool is useful is when a subject matter expert carefully reviews the results, in which case they may as well have written the answer themselves. At this stage it's just easier and better for everyone if AI is banned outright. (Not to mention, if people want an AI-generated answer, they can get it themselves. They come to AU/SE for quality human-written answers.) | |
| May 19, 2023 at 1:29 | comment | added | andrew.46 Mod | Well, we are not blindly banning AI content. We are actually, in a very focused way, trying to avoid anything like the tsunami of AI generated non-answers that is still afflicting Stack Overflow. I personally think that AI is a fantastic technology but its usage on Stack Exchange has always been very, very problematical. | |
| May 18, 2023 at 20:14 | comment | added | Franck Dernoncourt | @cocomac if an SE user tends to post incorrect answers, then they should be banned. Ban users, not the tools. | |
| May 18, 2023 at 18:09 | comment | added | cocomac | That sounds nice, but it doesn't really work in practice. While AI models sometimes do produce a correct answer, they often produce answers that sound right but are totally wrong, and most reviewers can't easily verify answers to ensure they are correct. Also, some users post tons of AI-generated answers which is annoying and problematic | |
| May 18, 2023 at 17:28 | history | answered | Franck Dernoncourt | CC BY-SA 4.0 |