Site scraping question
Ethan Blanton
elb at pidgin.im
Thu Jan 28 09:28:52 EST 2016
Andrej Nemec spake unto us the following wisdom:
> We monitor this page:
> http://www.pidgin.im/news/security/
>
> Is it all right for us to create a dump of this page every hour
> at maximum, to see if anything which we haven't yet encountered emerged?
Absolutely. In general, as long as you're not scraping trac (on
https://developer.pidgin.im/) or our hg repositories
(https://hg.pidgin.im/), you can pull any given page at a reasonable
rate without anyone even noticing.
Note that RH does have employees on the packagers@ list, which is
another good resource for this purpose. At a first glance, I see
huzaifas at redhat.com and thoger at redhat.com there.
Ethan
More information about the security
mailing list