5
Content Warning (lemmy.world)
submitted 2 weeks ago by to c/perchance@lemmy.world
25 comments fedilink hide all child comments
 

My generator, "Bestaigen," now displays the following warning—as shown in the attached image: "Warning: The moderation system flagged this page because it may log or publicly show user inputs that one might expect to be private by default. Please do not input any private information on this page. If you are the creator of this page, you can ask the AI ​​Helper to fix this issue." Furthermore, it no longer appears in the "Recently Updated Generators" list at "https://perchance.org/generators." My generator has been live for about two months, and this issue did not exist previously. The sequence of events is as follows: We have a feature called "Prompt Gallery." A user shared the following message in the chat:

"9V3A: URGENT: Illegal content found in Best AI Gen prompt history, On October 20th, 2026, while using the Best AI Gen image generator (perchance.org/bestaigen#generation), I opened the prompt dropdown menu and found user-generated prompts publicly visible in the prompt history depicting graphic sexual abuse of minors, which included characters described as young as 7 years old. Multiple such prompts were present and could be viewed and copied by anyone. I understand the site's Pedo Shield makes users responsible for generated content, but these prompts are publicly accessible and appear unmoderated. I have already reported this to Cybertipline. I'm requesting the immediate removal of these prompts from the prompt history, and a review of the generator's prompt history for further illegal content. Thank you for your time."

Although "Prompt History" is intended to be a private space where each user sees only their own prompts, I realized the user was actually referring to the "Prompt Gallery." Consequently, I expanded the "Pedo Shield" AI-moderation tool—already in place for our generator—to also cover the "Prompt Gallery." I subsequently informed the individual who raised the concern, as well as the generator's user base in general, via the chat. Following this, another user quoted my message and posted the following in the chat:

"KUV3: Probably best to allow the prompts to be filtered or removed entirely. Also allowing individuals to choose whether or not their prompts even get publicly shared without their consent regardless of anonymity. Some prompt styles are formulas for work they do, while most are petty indulgence. People who choose to share it can show off their prompt abilities. While obviously some are just. Horrible."

Agreeing with the user's concerns and thoughts, I added a "Share My Prompts" toggle—set to OFF by default—to the "Generate" page. This toggle controls whether prompts entered into the "prompt description" field are sent to the "Prompt Gallery" when the "Generate" button is clicked. After implementing this change and saving the code, I refreshed the page (F5) and encountered this warning: "Warning The moderation system flagged this page because it may log or publicly show user inputs that one might expect to be private by default. Please do not input any private information on this page. If you are the creator of this page, you can ask the AI ​​Helper to fix this issue.

🔙 Leave I understand "

I am not sure why this happened:

  • Was it due to the AI ​​code itself? (My generator had been public for two months without any issues prior to these changes.)
  • Did someone report it? Could it be related to the "Prompt Gallery" or a "Cybertipline" issue?
  • Could the automated bots on Perchance have monitored the chat or analyzed the saved generator code, resulting in a "false flag"? I don't know.
  • Regardless, the goals that both I and my community wish to achieve—and the values ​​we aim to protect—are clear.
  • As a safeguard for minors: I have implemented several safeguards: prompt filtering, a review process for images intended for upload to the public gallery, and strict constraints for the chatbot—including an 18+ age requirement for roleplay (RP) and fictional storytelling, as well as a complete prohibition on the inclusion of minor characters.
  • The "Content Mode" setting in the generator is configured to the default "G" (General) level.
  • A "Pedo Shield" notification and warning appear in the welcome panel for first-time visitors; this same warning is also permanently displayed at the very top of the generator's settings page.
  • Regarding the optional user login system I previously considered: I decided against implementing it after users expressed a strong preference for remaining anonymous.

Following the appearance of this warning window, I had an AI review the code, removed potentially ambiguous phrasing, and reverted all recent changes—yet the generator still displays the same warning window. Could you please assist me? What, specifically, is triggering this warning? The only user-provided content that could potentially be made public—prompts—is now set to "private" by default, subject to user preference. Dear Perchance moderators, if there are any other issues or content you deem inappropriate or problematic, please let me know; I am fully prepared to make the necessary adjustments.

you are viewing a single comment's thread
view the rest of the comments
[–] [S] 3 points 2 weeks ago* (last edited 2 weeks ago) (1 child)

First of all, thank you very much for your quick response. Yes, the previous warning—"Warning: The moderation system flagged this page because it may log or publicly show user inputs that one might expect to be private by default"—has disappeared, but now I’m getting a "Mature Content" warning. While I understand why this is happening—given that my generator’s design included an "NSFW" option under the "Content Mode" settings—I’d like to remove it. It’s quite embarrassing for me when someone visits my generator and is immediately confronted with an age-verification (18+) prompt. I don’t want to be perceived as someone who creates "pornographic content generators"—especially since people I know in real life, including my spouse, visit my site. I did add an age-verification step yesterday for when the "Content Mode" switch is toggled to "+18," but it seems your moderation AI didn’t consider that sufficient; the age-verification prompt still pops up the moment someone lands on the page. This can also make the user feel uncomfortable. I’ve decided to strip my generator of all NSFW or sexually suggestive content, as it seems to be the only way to remove this warning. That said, I still believe that if content is "gated" within the code by the generator’s creator, it shouldn’t trigger a warning—after all, a "typical user" wouldn’t even encounter that content unless they manually changed the "Content Mode" themselves (and I had already implemented an age-verification prompt for that specific scenario).

Since I have you here, I have a few other questions and requests; I would be very happy and grateful if you could look into them and provide an answer:

  • What steps are required to become a "pinned" (featured) generator owner at https://perchance.org/generators? I haven’t been able to get a clear or sufficient answer—neither from AI nor from my own research. I’ve noticed that some generators with only 14 views get pinned, while others that were created just a few hours ago also get pinned. It feels a bit unfair.
  • Some features in my generator rely on "Durable State" (DS), which is subject to a 50ms traffic limit. This limit is far too low; even a very simple feature using DS can easily trigger a "quarantine" status due to "traffic overflow." This affects other features as well, creating a snowball effect. Is it possible to increase this 50ms traffic limit?
  • Because of the DS traffic constraints, I’m unable to build a proper, functional chat panel. I’ve been forced to use the "Default Comment Plugin," but it is extremely limited. Increasing both the DS storage space and the traffic limit would provide us, as generator owners, with more creative possibilities. Furthermore, regarding the "Default Comment Plugin," would it be possible to add features such as badges, a list of online users, a private messaging system, a "moderator" role (with admin-level permissions, since we aren't always online), and reaction emojis for chat messages (e.g., thumbs-up, heart, sad face, etc.)?
  • Currently, as generator owners, our permissions are extremely restricted; we cannot even delete images from our own generator's gallery. I am currently able to hide or "ban" problematic content—such as images depicting child abuse or other objectionable material—by using a custom "Image Card" system that conceals the default gallery. However, these images still remain visible in the "Default Perchance" gallery associated with the generator. For instance, the "Block this user" button found on default images is contained within an iframe, which prevents it from functioning with my custom card system. Could you make these accessible to generator owners? This would allow the buttons we integrate into our own card systems to function in sync with the standard "Block this user/report" features.
  • I have personally created a password-protected, private page for my generator (https://perchance.org/bestaigen#closecodeadmin), which is the only place where I can report or hide images that I identify as problematic. I believe that generator owners who are logged in should have access to an admin panel—perhaps located under "Perchance default/Account - View your generators"—that grants them the authority to ban users, delete images from their generator's gallery, adjust ratings, and assign moderators. Currently, every image generated places a burden on you; by enabling generator owners to manage this, the workload could be shared. Wouldn't this be a significant step toward a cleaner Perchance?

Thank you very much in advance for your response; I look forward to hearing from you. Perchance is a fantastic platform—please continue to show it your care and support. Perchance = Real Free Internet. @perchance@lemmy.world

@perchance@lemmy.world

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 1 child comment
    •
  • [–] 2 points 2 weeks ago

    the default comment plugin and image-to-text gallery should open some more api/options :(

    owner either user server and suffer from 50MiB cap, or hybrid/geek and hack here and there currently

    some build a custom gallery by storage image url in comment and render them. wow, so creative! live will always find a way out right?

  • permalink
  • fedilink
  • source
  • parent