Want to stop chatGPT from crawling your website? Just mention Australian mayor Brian Hood (or any of the other names listed in the article)

When asked about these names, ChatGPT responds with “I’m unable to produce a response” or “There was an error generating a response” before terminating the chat session, according to Ars’ testing. The names do not affect outputs using OpenAI’s API systems or in the OpenAI Playground (a special site for developer testing).

The filter also means that it’s likely that ChatGPT won’t be able to answer questions about this article when browsing the web, such as through ChatGPT with Search. Someone could use that to potentially prevent ChatGPT from browsing and processing a website on purpose if they added a forbidden name to the site’s text.

You are viewing a single thread.
View all comments View context
5 points

Maybe it was a way to get the engine to say it doesn’t know “brain” hood, and when they asked it to look it up, their hits autocorrected to “Brian,” and that’s how they got the information past the filter. Which would be incredibly clever, and it’s I believe how it actually got past it, not the leetspeak.

permalink
report
parent
reply
8 points

Nop, it’s the leetspeak. That trick has worked great for me, I don’t know why chatgpt hasn’t patched it yet. Google figured that out back when their servers held 40gb and were build out of legos

permalink
report
parent
reply
1 point

I posted another example above using leetspeak to bypass it, pretty silly.

permalink
report
parent
reply