iPromKnight
aeb83c19f8
Simplification of parsing in consumer
...
should speed up massively especially if imdbIds are found from mongodb
2024-03-11 10:56:04 +00:00
iPromKnight
6600fceb1a
Wip Blacklisting dmm porn
...
Create adult text classifier ML Model
wip - starting to write PTN in c#
More work on season, show and movie parsing
Remove ML project
2024-03-10 12:48:16 +00:00
iPromKnight
65b8fe588b
Further enhance title matching by added fuse with a threshold of a 75% match
2024-02-29 21:39:31 +00:00
iPromKnight
9c8cbf6468
Plug in the new mongo imdb lookups into the consumer
2024-02-28 04:03:50 +00:00
iPromKnight
0428b3a83c
remove node-gyp
2024-02-12 08:46:43 +00:00
iPromKnight
360bc20970
Comment resolution
2024-02-11 21:45:17 +00:00
iPromKnight
c2ada8344e
fix lint fix command
2024-02-11 21:45:17 +00:00
iPromKnight
901186c109
back to npm
2024-02-11 21:45:17 +00:00
iPromKnight
8bba2aa284
fix magnet uri by download, and add torrent download service test
2024-02-11 21:45:17 +00:00
iPromKnight
373ca4e024
fix dockerfile, add tracker tests
2024-02-11 21:45:17 +00:00
iPromKnight
4bc4b7958f
switched to yarn, and started adding tests
...
Added tests for process job service so far... its a start..
2024-02-11 21:45:17 +00:00
iPromKnight
ed6b08dbc4
switch to yarn
2024-02-11 21:45:17 +00:00
iPromKnight
6919622c30
meta data seems a bit iffy right now
...
Also gone back to torrent-stream
WebTorrent seemed to be throwing the occasional engine crash
2024-02-11 21:45:17 +00:00
iPromKnight
028bb122e1
back to esbuild- imports changed
2024-02-11 21:45:17 +00:00
iPromKnight
9aba1c13b1
And thats what happens when you do a crapload of work with *.ts in .eslintignore... :/
2024-02-11 21:45:17 +00:00
iPromKnight
7fe9b64f66
replace torrent-stream (high vunerabilities) with webtorrent, gives us clean package audit
2024-02-11 21:45:17 +00:00
iPromKnight
0f3e20eef3
trackers needs to be singleton, loggers should. be too
2024-02-11 21:45:17 +00:00
iPromKnight
5ebb9b4ae8
ioc implemented
2024-02-11 21:43:01 +00:00
iPromKnight
9982fc1093
eslint cleanup - addded as const check tooo
2024-02-11 21:43:01 +00:00
iPromKnight
a84ca68d9e
some comment resolution - enums, process_torrents_job
2024-02-11 21:43:01 +00:00
iPromKnight
3f8fee518e
torrent file service done - bound to be some issues in this..
2024-02-11 21:43:01 +00:00
iPromKnight
29371b2192
further lunchtime cleanup
...
Three files left: torrentEntries, torrentFiles torrentSubtitles
2024-02-11 21:43:01 +00:00
iPromKnight
cf25f32cb6
Torrent processing orchestrator now typescript too
...
Will start to tackle some of the other services after work tomorrow.
2024-02-11 21:43:01 +00:00
iPromKnight
204fe51658
Rewritten repository in typescript
2024-02-11 21:43:01 +00:00
iPromKnight
678b3857f3
Add pino as a logger, and update cache manager
...
Rewrites the cache service to use the latest implementation of cache manager, and bring in the new mongo package.
Introduce Logger service
Removes bluebird as a dependency
2024-02-03 22:05:15 +00:00
iPromKnight
8ad6cf731c
harden consumer
2024-02-02 14:04:53 +00:00
iPromKnight
ab17ef81be
Big rewrite - distributed consumers for ingestion / scraping(scalable) - single producer written in c#.
...
Changed from page scraping to rss xml scraping
Includes RealDebridManager hashlist decoding (requires a github readonly PAT as requests must be authenticated) - This allows ingestion of 200k+ entries in a few hours.
Simplifies a lot of torrentio to deal with new data
2024-02-01 16:38:45 +00:00
