tools/knightcrawler
1
0
Fork 0
mirror of https://github.com/knightcrawler-stremio/knightcrawler.git synced 2024-12-20 03:29:51 +00:00
Code Issues Actions Packages Projects Releases Wiki Activity

moves scraper to a subpackage

Browse Source
This commit is contained in:
TheBeastLT
2020-03-10 15:12:18 +01:00
parent dff66d8fb2
commit 58aba322c2
30 changed files with 50 additions and 28 deletions
Download Patch File Download Diff File Expand all files Collapse all files

26
README.md
View File

@@ -1,23 +1,5 @@
# Torrentio Scraper
# Torrentio
## Initial dumps
### The Pirate Bay
https://mega.nz/#F!tktzySBS!ndSEaK3Z-Uc3zvycQYxhJA
https://thepiratebay.org/static/dump/csv/
### Kickass
https://mega.nz/#F!tktzySBS!ndSEaK3Z-Uc3zvycQYxhJA
https://web.archive.org/web/20150416071329/http://kickass.to/api
### Migrating Database
When migrating database to a new one it is important to alter the `files_id_seq` sequence to the maximum file id value plus 1.
```sql
ALTER SEQUENCE files_id_seq RESTART WITH <last_file_id + 1>;
```
Torrentio includes 2 parts:
- [torrentio-scraper](scraper) - a background process continuously scrapping newest torrents from configured torrent providers.
- [torrentio-addon](addon) - the Stremio addon which will query scraped entries and return Stremio stream results.