Site scraping question
anemec at redhat.com
Thu Jan 28 09:35:44 EST 2016
On 28/01/16 15:28, Ethan Blanton wrote:
> Andrej Nemec spake unto us the following wisdom:
>> We monitor this page:
>> Is it all right for us to create a dump of this page every hour
>> at maximum, to see if anything which we haven't yet encountered emerged?
> Absolutely. In general, as long as you're not scraping trac (on
> https://developer.pidgin.im/) or our hg repositories
> (https://hg.pidgin.im/), you can pull any given page at a reasonable
> rate without anyone even noticing.
> Note that RH does have employees on the packagers@ list, which is
> another good resource for this purpose. At a first glance, I see
> huzaifas at redhat.com and thoger at redhat.com there.
Thanks for the answer!
We are monitoring only this page, as this is only a fallback mechanism
to catch issues we missed elsewhere :)
Have a nice day!
More information about the security