Site scraping question

Ethan Blanton elb at pidgin.im
Thu Jan 28 09:28:52 EST 2016


Andrej Nemec spake unto us the following wisdom:
> We monitor this page:
> http://www.pidgin.im/news/security/
> 
> Is it all right for us to create a dump of this page every hour
> at maximum, to see if anything which we haven't yet encountered emerged?

Absolutely.  In general, as long as you're not scraping trac (on
https://developer.pidgin.im/) or our hg repositories
(https://hg.pidgin.im/), you can pull any given page at a reasonable
rate without anyone even noticing.

Note that RH does have employees on the packagers@ list, which is
another good resource for this purpose.  At a first glance, I see
huzaifas at redhat.com and thoger at redhat.com there.

Ethan


More information about the security mailing list