Commit Graph

16 Commits

Author SHA1 Message Date
TheBeastLT
d9eb5f3b35 [scraper] removes proxy for katcr 2020-09-17 21:33:38 +02:00
TheBeastLT
9ce3f72e5d [scraper] checks for torrent contents when updating existing torrent 2020-05-06 11:59:53 +02:00
TheBeastLT
9123c1ffd8 [scraper] reduces concurrent entry processing limit 2020-05-02 22:20:19 +02:00
TheBeastLT
2bb0570194 [scraper] adds proxy for kat and 1337x 2020-05-02 17:35:50 +02:00
TheBeastLT
aa0bf8da44 [scraper] fixes seeders updating if provider not found 2020-04-23 17:08:18 +02:00
TheBeastLT
9ea3932af1 [scraper] rework scraper scheduling and added seeders updating 2020-04-23 16:46:04 +02:00
TheBeastLT
6bfba11692 [scraper] updates includes api extracted languages 2020-04-13 22:46:17 +02:00
TheBeastLT
ce0e330172 [scraper] adds update seeders cron 2020-04-08 16:06:02 +02:00
TheBeastLT
760c577ca7 [scraper] removes proxy from kat 2020-04-03 16:28:54 +02:00
TheBeastLT
2833c9d3a2 [scraper] adds helper class for proxy and user agent 2020-04-02 22:47:52 +02:00
TheBeastLT
7e7e46a5f3 [scraper] updates tpb proxies 2020-03-16 14:48:57 +01:00
TheBeastLT
326a07b82e [scraper] updates scrapers and unique index 2020-03-14 22:25:51 +01:00
TheBeastLT
542c96a2c3 [scraper] updates scapers limiter usage 2020-03-13 22:24:22 +01:00
TheBeastLT
c6e0c01850 [scraper] adds scheduling flag to enable it 2020-03-12 09:02:50 +01:00
TheBeastLT
a2ea880cb6 pads zeros to imdbId if missing 2020-03-10 21:37:20 +01:00
TheBeastLT
58aba322c2 moves scraper to a subpackage 2020-03-10 15:23:52 +01:00