On Wed, Jun 05, 2024 at 12:59:03PM GMT, Jason L Tibbitts III wrote:
Adrian Reber via Mirror-admin mirror-admin@lists.fedoraproject.org writes:
It was disabled for non-private mirrors as it does not provide really correct results.
OK, that makes sense. Though I'll reiterate that if there was a way to provide correct results, I would be happy to at least attempt to do so. It makes a lot of sense to do it immediately after new content has been downloaded, but of course that might mean a lot of hosts hammering the server immediately after a new big content push. Surely it has to be more efficient to make the client do the work to create a nice compressed payload instead of parsing rsync directory listings.
yeah, but... the problem was this: mirrors would run a script of some kind to sync content, it would fail for whatever reason, but they called report_mirror at the end unconditionally.
So, then the mirror would be marked up to date, the crawler would remove it for being out of date, then the script would mark it up to date again, repeat.
kevin