I think some of us would be quite happy to have this tool tell us “no, you are not visible” and may be useful for this purpose.
3 Likes
Neat little tool it is.
My site scores bad, and needs attention. So yeah thats a good thing i guess.
My forum got visited by petalbot this morning, so that is not good. Gonna add some more User-Agent blocks when i’m up
“You entered your website in the box? Now you are!”
site doesnt want me on there so bad that it crashes anytime i try to look up my site on there. maybe it’s a sign
1 Like
Not to be too much of a downer, but this appears to check if your site is visible to the AIs internal search function. I.e. if a user asks a question with search turned on, will the AI be able to find your site
This is a totally different question to “Are the LLMs training on my site” and I would expect the training scrapers to behave very differently to the inference search agents. (I.e. to behave worse and break more rules)
So I don’t really think this tells you all that much for the purposes you are concerned about.
2 Likes
Besides, this site’s copy is all based on the premise that you should want your site to be accessible to LLMs. Screw that.
I’m confused by this site. It seems to consider it a problem that AIs might have insufficient access…?
Does it even work if you don’t have your own domain? I entered my blog into it and got 0 on everything, which I’m not sure makes sense…
I think this site is only checking robots.txt and not actually trying to access the site. My nginx rules disallow a bunch of LLM user agents, but I still get 100 score.
This tool stinx
Yes, that seems to be the case. Never mind that the only part of any website an AI should be able to access is /dev/null.
1 Like