Commit Graph

107 Commits

Author SHA1 Message Date
Gabisonfire
d54b5dbc33 New logo 2024-03-03 19:09:38 -05:00
iPromKnight
a609af66f9 change default retry window to be a larger delay
Lets not hammer them
2024-03-03 20:28:53 +00:00
iPromKnight
c3a281c39f retry polic and circuit breaker policy 2024-03-03 19:54:32 +00:00
iPromKnight
62decbf994 Ensure we throw
when torrentio/knightcrawler instances return invalid status codes on fetch requests for json payloads, pre-parsing of json, polly will catch in the policy wrapped resiliency handler
2024-03-03 19:30:06 +00:00
iPromKnight
c61e9e94e1 Rethrow so polly captures failures on requests. 2024-03-03 19:22:10 +00:00
iPromKnight
d8f48fcee9 Introduce a circuit breaker, also exit out of loop if mongo failures. 2024-03-03 16:19:56 +00:00
iPromKnight
4b3bb2b5bd hotfix continue, not break - add slight delay - log params 2024-03-03 04:10:14 +00:00
iPromKnight
95fa48c851 Woke up to see a discussion about torrentio scraping: powered by community
Was a little inspired. Now we have a database (self populating) of imdb id's - why shouldn't we actually have the ability to scrape any other instance of torrentio, or knightcrawler?

Also restructured the producer to be vertically sliced to make it easier to work with
Too much flicking back and forth between Jobs and Crawlers when configuring
2024-03-02 18:41:57 +00:00
iPromKnight
38d4e5d5ed Allow user control of threshold 2024-02-29 21:47:07 +00:00
iPromKnight
65b8fe588b Further enhance title matching by added fuse with a threshold of a 75% match 2024-02-29 21:39:31 +00:00
Gabisonfire
db1a266a87 Merge pull request #97 from Gabisonfire/fix/premiumize
Updated premiumize moch from upstream
2024-02-29 09:24:03 -05:00
iPromKnight
0f0298887c Change startup url to avoid conflict 2024-02-29 11:23:18 +00:00
iPromKnight
fcc4440a7d small hotfix to use fuzzy text lookups and actually utilise the compound index. 2024-02-29 11:23:18 +00:00
iPromKnight
d0346f29bf Add cleanup of initialize mongodb, ensure indexes are created for compound searching 2024-02-28 14:57:26 +00:00
iPromKnight
1b9a01c677 BREAKING: Cleanup RabbitMQ env vars, and Github Pat 2024-02-28 12:57:55 +00:00
iPromKnight
a25aef8f58 dont restart the metadata service when it completes, and exit if its a single run 2024-02-28 11:51:46 +00:00
iPromKnight
42f55318e4 change mongodb env var in addon - breaking 2024-02-28 10:16:34 +00:00
iPromKnight
acff67d7ba Cleanup the mongodb env - breaking change
Fixes the consumer tests
2024-02-28 10:14:20 +00:00
iPromKnight
9c8cbf6468 Plug in the new mongo imdb lookups into the consumer 2024-02-28 04:03:50 +00:00
iPromKnight
79d0ef7f4d Create service to populate Imdb data collection within mongo
We can use this collection as an alternative source to lookup imdb ids, which would be executed before name_to_imdb is called in the consumer.
2024-02-27 22:39:19 +00:00
Gabisonfire
6c4282b6de Adds Nyaa Crawler 2024-02-27 10:08:39 -05:00
Gabisonfire
c7cf84ae62 Updated premiumize moch from upstream 2024-02-27 09:22:50 -05:00
iPromKnight
49a6283f26 Fix DMM so that all pages are enumerated
Fixes #95 by switching to git trees instead of the content api.
2024-02-27 13:51:21 +00:00
Aelfa
62380e5f3c pgrep command is part of the procps package, installed in the builder stage, but it's not present in the final stage.
This modification adds the installation of procps in the final stage, ensuring that the pgrep command is available for health check.
2024-02-21 03:58:36 +05:00
Aelfa
0a2c9ad1f0 Update Dockerfile 2024-02-21 03:22:16 +05:00
Aelfa
496b12c680 Resolve "pgrep: not found" issue
Resolve "pgrep: not found" issue

Added installation of the procps package in the builder stage to ensure the pgrep command is available in the final Docker image. This resolves the "pgrep: not found" issue in the HEALTHCHECK.
2024-02-19 01:31:14 +05:00
iPromKnight
8a61c0c5b0 Fix the entrypoint 2024-02-18 12:36:04 +00:00
iPromKnight
0925c2fb51 Cleanup boolean helpers 2024-02-13 19:51:49 +00:00
iPromKnight
40e1267572 tested - we dont need this 2024-02-12 08:52:00 +00:00
iPromKnight
0428b3a83c remove node-gyp 2024-02-12 08:46:43 +00:00
iPromKnight
d76ac286a1 Update src/node/consumer/esbuild.ts
Co-authored-by: Sleeyax <yourd3veloper@gmail.com>
2024-02-11 21:50:59 +00:00
iPromKnight
189128bbc1 Fix boolean helpers - also add tests for all helpers, and expand config tests to test values for booleans 2024-02-11 21:45:17 +00:00
iPromKnight
29a619c528 Didn't mean to remove this. Latest stable lts 2024-02-11 21:45:17 +00:00
iPromKnight
360bc20970 Comment resolution 2024-02-11 21:45:17 +00:00
iPromKnight
e04f2d01a4 Start of some file service tests. final service that needed to be tested
We need a lot more tests in this - its the main processor for the consumer really
2024-02-11 21:45:17 +00:00
iPromKnight
740b75f106 add assign subtitles tests, and fix subtitles service 2024-02-11 21:45:17 +00:00
iPromKnight
36864e4db1 tests to ensure entries are created 2024-02-11 21:45:17 +00:00
iPromKnight
c2ada8344e fix lint fix command 2024-02-11 21:45:17 +00:00
iPromKnight
fe8b7a096d few more metadata tests and a single torrent entry service test for now 2024-02-11 21:45:17 +00:00
iPromKnight
001d10fac9 dont like where i put assets - moved them closer to the mock response methods that use them 2024-02-11 21:45:17 +00:00
iPromKnight
82cf976273 start adding metadata tests 2024-02-11 21:45:17 +00:00
iPromKnight
901186c109 back to npm 2024-02-11 21:45:17 +00:00
iPromKnight
8bba2aa284 fix magnet uri by download, and add torrent download service test 2024-02-11 21:45:17 +00:00
iPromKnight
373ca4e024 fix dockerfile, add tracker tests 2024-02-11 21:45:17 +00:00
iPromKnight
2b1bb5fb16 logging service tests 2024-02-11 21:45:17 +00:00
iPromKnight
9401b6f8f1 Config service tests 2024-02-11 21:45:17 +00:00
iPromKnight
39511f6a5b Add cache service tests 2024-02-11 21:45:17 +00:00
iPromKnight
9308577190 fix small error so typescript knows type assigned 2024-02-11 21:45:17 +00:00
iPromKnight
4bc4b7958f switched to yarn, and started adding tests
Added tests for process job service so far... its a start..
2024-02-11 21:45:17 +00:00
iPromKnight
ed6b08dbc4 switch to yarn 2024-02-11 21:45:17 +00:00