iPromKnight
6c03f79933
Complete
2024-03-10 13:48:27 +00:00
iPromKnight
320fccc8e8
[skip ci] More work on parsing - seasons to fix still and use banned words
2024-03-10 12:48:19 +00:00
iPromKnight
6600fceb1a
Wip Blacklisting dmm porn
...
Create adult text classifier ML Model
wip - starting to write PTN in c#
More work on season, show and movie parsing
Remove ML project
2024-03-10 12:48:16 +00:00
purple_emily
79409915cf
Run pre-commit
2024-03-08 14:34:53 +00:00
iPromKnight
1b9a01c677
BREAKING: Cleanup RabbitMQ env vars, and Github Pat
2024-02-28 12:57:55 +00:00
iPromKnight
68edaba308
Introduce max batch size, and configurable publish window
...
Still need to implement queue size limit
Also fixes env var consistency between addon and consumer
2024-02-02 13:49:54 +00:00
iPromKnight
ab17ef81be
Big rewrite - distributed consumers for ingestion / scraping(scalable) - single producer written in c#.
...
Changed from page scraping to rss xml scraping
Includes RealDebridManager hashlist decoding (requires a github readonly PAT as requests must be authenticated) - This allows ingestion of 200k+ entries in a few hours.
Simplifies a lot of torrentio to deal with new data
2024-02-01 16:38:45 +00:00
