Commit Graph

15 Commits

Author SHA1 Message Date
iPromKnight
6919622c30 meta data seems a bit iffy right now
Also gone back to torrent-stream
WebTorrent seemed to be throwing the occasional engine crash
2024-02-11 21:45:17 +00:00
iPromKnight
028bb122e1 back to esbuild- imports changed 2024-02-11 21:45:17 +00:00
iPromKnight
9aba1c13b1 And thats what happens when you do a crapload of work with *.ts in .eslintignore... :/ 2024-02-11 21:45:17 +00:00
iPromKnight
7fe9b64f66 replace torrent-stream (high vunerabilities) with webtorrent, gives us clean package audit 2024-02-11 21:45:17 +00:00
iPromKnight
0f3e20eef3 trackers needs to be singleton, loggers should. be too 2024-02-11 21:45:17 +00:00
iPromKnight
5ebb9b4ae8 ioc implemented 2024-02-11 21:43:01 +00:00
iPromKnight
9982fc1093 eslint cleanup - addded as const check tooo 2024-02-11 21:43:01 +00:00
iPromKnight
a84ca68d9e some comment resolution - enums, process_torrents_job 2024-02-11 21:43:01 +00:00
iPromKnight
3f8fee518e torrent file service done - bound to be some issues in this.. 2024-02-11 21:43:01 +00:00
iPromKnight
29371b2192 further lunchtime cleanup
Three files left: torrentEntries, torrentFiles torrentSubtitles
2024-02-11 21:43:01 +00:00
iPromKnight
cf25f32cb6 Torrent processing orchestrator now typescript too
Will start to tackle some of the other services after work tomorrow.
2024-02-11 21:43:01 +00:00
iPromKnight
204fe51658 Rewritten repository in typescript 2024-02-11 21:43:01 +00:00
iPromKnight
678b3857f3 Add pino as a logger, and update cache manager
Rewrites the cache service to use the latest implementation of cache manager, and bring in the new mongo package.
Introduce Logger service
Removes bluebird as a dependency
2024-02-03 22:05:15 +00:00
iPromKnight
8ad6cf731c harden consumer 2024-02-02 14:04:53 +00:00
iPromKnight
ab17ef81be Big rewrite - distributed consumers for ingestion / scraping(scalable) - single producer written in c#.
Changed from page scraping to rss xml scraping
Includes RealDebridManager hashlist decoding (requires a github readonly PAT as requests must be authenticated) - This allows ingestion of 200k+ entries in a few hours.
Simplifies a lot of torrentio to deal with new data
2024-02-01 16:38:45 +00:00