knightcrawler

tools/knightcrawler

Fork 0

mirror of https://github.com/knightcrawler-stremio/knightcrawler.git synced 2024-12-20 03:29:51 +00:00

Commit Graph

Author	SHA1	Message	Date
iPromKnight	ab17ef81be	Big rewrite - distributed consumers for ingestion / scraping(scalable) - single producer written in c#. Changed from page scraping to rss xml scraping Includes RealDebridManager hashlist decoding (requires a github readonly PAT as requests must be authenticated) - This allows ingestion of 200k+ entries in a few hours. Simplifies a lot of torrentio to deal with new data	2024-02-01 16:38:45 +00:00

Author

SHA1

Message

Date

iPromKnight

ab17ef81be

Big rewrite - distributed consumers for ingestion / scraping(scalable) - single producer written in c#.

Changed from page scraping to rss xml scraping
Includes RealDebridManager hashlist decoding (requires a github readonly PAT as requests must be authenticated) - This allows ingestion of 200k+ entries in a few hours.
Simplifies a lot of torrentio to deal with new data

2024-02-01 16:38:45 +00:00

1 Commits