This could be done at the web server level, not requiring changes to Anubis

It could be, but if it's a few lines of config in Anubis it would be easier and more likely to actually be done.

yep, that's the exact play. Or better fingerprinted & blocked in other ways

I've done a few --execute --i-know-what-im-doing for some more dangerous scripts

May I recommend --I-take-responsibility-for-the-outcome-of-proceeding and require a capital I?

Author of caddy-defender and one of the Anubis maintainers here.

Definitely something that's important. An Anubis caddy plugin is in the works too! See https://github.com/TecharoHQ/anubis/issues/16

However anything in caddy would likely still be a plugin and non native

I have a pretty similar one. (Works off of the same concept) https://github.com/JasonLovesDoggo/caddy-defender if you're curious. Keep in mind this will not protect you against residential IP scraping.

see https://github.com/TecharoHQ/anubis/issues/16

There is going to be a pretty big refactor soon, but once that's done we plan on crushing this out.

Yeah. Unfortunately at the current moment it does prevent indexing. Perhaps down the line we can whitelist search engines ips. However some like google, use the same for the AI and search indexing.

We are still making some improvements like passing open graph tags through so at least rich previews work!

:O I made this lol