Commit Graph

34 Commits

Author SHA1 Message Date
TheBeastLT
fd2f3cc5b7 [scraper] update seeders from trackers directly 2021-02-07 18:42:21 +01:00
TheBeastLT
b333607209 [scraper] ignores duplicates when creating contents 2021-01-12 12:15:05 +01:00
TheBeastLT
519799b634 [scraper] adds anime specific trackers 2020-12-02 19:30:23 +01:00
TheBeastLT
5b82ac33be [scraper] exclude nyaasi torrents from seeders query 2020-12-02 17:58:07 +01:00
TheBeastLT
b4c217f4e7 [scraper] adds nyaa si scraper 2020-12-01 10:59:29 +01:00
TheBeastLT
10e35c1393 [scraper] updates seeders repository condition 2020-10-19 21:28:24 +02:00
TheBeastLT
5426707dd9 [scraper] reduces number of calls to 1337x 2020-10-02 12:49:45 +02:00
TheBeastLT
f0939f9943 [scraper] implements custom rargb api class 2020-05-26 23:22:08 +02:00
TheBeastLT
d9203a88cc [scraper] disable rarbg scraper for now 2020-05-13 22:05:08 +02:00
TheBeastLT
11e20beeac [scraper] fixes trackers cache method ttl 2020-05-12 18:07:57 +02:00
TheBeastLT
9ce3f72e5d [scraper] checks for torrent contents when updating existing torrent 2020-05-06 11:59:53 +02:00
TheBeastLT
6c9313a0f4 [scraper] reverts json subtitlesIndexes column 2020-05-04 22:15:58 +02:00
TheBeastLT
d47cf4304e [scraper] assigns subtitle indexes directly to file table as json array 2020-05-04 21:46:39 +02:00
TheBeastLT
4b31aa9024 [scraper] excludes nyaa pantsu from seeders update for now 2020-05-03 23:07:20 +02:00
TheBeastLT
129a9ed29d [scraper] retrieves update seeders torrent order by seeders and upload date 2020-05-03 22:54:49 +02:00
TheBeastLT
4507b1bd1d [scraper] assign subtitles to videos 2020-05-02 19:48:02 +02:00
TheBeastLT
6bd8a05ba4 [scraper] upsert subtitles when updating existing file 2020-05-02 18:08:36 +02:00
TheBeastLT
cd5fac2f60 [scraper] upsert existing video 2020-05-02 17:12:28 +02:00
TheBeastLT
14b2f6b1a2 [scraper] saves opened torrent contents and videos and subs separately 2020-05-02 10:16:03 +02:00
TheBeastLT
4cf7bfb04a [scraper] create subtitle database model 2020-04-30 11:29:23 +02:00
TheBeastLT
529f5ba76c [scraper] simplify update seeders query 2020-04-28 09:29:40 +02:00
TheBeastLT
0be7dc4638 [scraper] cleans up repository methods 2020-04-25 14:13:19 +02:00
TheBeastLT
ce0e330172 [scraper] adds update seeders cron 2020-04-08 16:06:02 +02:00
TheBeastLT
2eefdc76ec [scraper] use same cached proxy for rd requests 2020-04-04 16:52:12 +02:00
TheBeastLT
db78f5873b [scraper] get torrent size for horriblesubs 2020-04-02 20:58:08 +02:00
TheBeastLT
97cbe5d6c1 [scraper] fixes update seeders method 2020-03-30 14:48:22 +02:00
TheBeastLT
5f429ebdc0 [scraper] do not use imdbId for series from tpb 2020-03-20 14:25:05 +01:00
TheBeastLT
2ea787c0c7 [scraper] updates tpb dum scraper 2020-03-15 11:24:18 +01:00
TheBeastLT
326a07b82e [scraper] updates scrapers and unique index 2020-03-14 22:25:51 +01:00
TheBeastLT
21338b3aee [scraper] date handling 2020-03-13 15:46:39 +01:00
TheBeastLT
a47495281d [scraper] removes unique index on files 2020-03-13 15:46:39 +01:00
TheBeastLT
3ec32b718b [scraper] removes unnecessary file index 2020-03-13 09:48:22 +01:00
TheBeastLT
a3cc795680 adds language and resolution to torrent table 2020-03-12 14:27:55 +01:00
TheBeastLT
58aba322c2 moves scraper to a subpackage 2020-03-10 15:23:52 +01:00