Commit Graph

1054 Commits

Author SHA1 Message Date
Gabisonfire
a6ce58c516 Merge pull request #112 from Gabisonfire/feat/icon
New logo
2024-03-03 19:18:54 -05:00
Gabisonfire
d54b5dbc33 New logo 2024-03-03 19:09:38 -05:00
iPromKnight
ab9d26e78e Merge pull request #111 from iPromKnight/change-retry
change default retry window to be a larger delay
2024-03-03 20:29:16 +00:00
iPromKnight
a609af66f9 change default retry window to be a larger delay
Lets not hammer them
2024-03-03 20:28:53 +00:00
iPromKnight
8298d4021f Merge pull request #110 from iPromKnight/hotfix-introduce-retry-policy-too
retry polic and circuit breaker policy
2024-03-03 19:54:54 +00:00
iPromKnight
c3a281c39f retry polic and circuit breaker policy 2024-03-03 19:54:32 +00:00
iPromKnight
a90462a112 Merge pull request #109 from iPromKnight/hotfix-throw-on-invalid-status-code
Ensure we throw
2024-03-03 19:30:29 +00:00
iPromKnight
62decbf994 Ensure we throw
when torrentio/knightcrawler instances return invalid status codes on fetch requests for json payloads, pre-parsing of json, polly will catch in the policy wrapped resiliency handler
2024-03-03 19:30:06 +00:00
iPromKnight
5dd53de40c Merge pull request #108 from iPromKnight/hotfix-rethrow
Rethrow so polly captures failures on requests.
2024-03-03 19:22:37 +00:00
iPromKnight
c61e9e94e1 Rethrow so polly captures failures on requests. 2024-03-03 19:22:10 +00:00
iPromKnight
9e32e5fe19 Merge pull request #107 from iPromKnight/circuit-breaker
Introduce a circuit breaker, also exit out of loop if mongo failures.
2024-03-03 16:43:20 +00:00
iPromKnight
d8f48fcee9 Introduce a circuit breaker, also exit out of loop if mongo failures. 2024-03-03 16:19:56 +00:00
iPromKnight
274e566336 Merge pull request #106 from iPromKnight/hotfix-producer-dont-break
hotfix continue, not break - add slight delay - log params
2024-03-03 04:11:34 +00:00
iPromKnight
4b3bb2b5bd hotfix continue, not break - add slight delay - log params 2024-03-03 04:10:14 +00:00
Gabisonfire
cd05013f2b Merge pull request #105 from iPromKnight/community-powered-idea
Woke up to see a discussion and comments such as: powered by community tagline
2024-03-02 20:19:55 -05:00
iPromKnight
95fa48c851 Woke up to see a discussion about torrentio scraping: powered by community
Was a little inspired. Now we have a database (self populating) of imdb id's - why shouldn't we actually have the ability to scrape any other instance of torrentio, or knightcrawler?

Also restructured the producer to be vertically sliced to make it easier to work with
Too much flicking back and forth between Jobs and Crawlers when configuring
2024-03-02 18:41:57 +00:00
iPromKnight
98115e0cf7 Merge pull request #104 from Gabisonfire/fuse-weighting
Further enhance title matching by added fuse with a configurable threshold
2024-03-01 09:02:24 +00:00
iPromKnight
38d4e5d5ed Allow user control of threshold 2024-02-29 21:47:07 +00:00
iPromKnight
65b8fe588b Further enhance title matching by added fuse with a threshold of a 75% match 2024-02-29 21:39:31 +00:00
Gabisonfire
db1a266a87 Merge pull request #97 from Gabisonfire/fix/premiumize
Updated premiumize moch from upstream
2024-02-29 09:24:03 -05:00
iPromKnight
ccb5938de9 Merge pull request #103 from iPromKnight/hotfix-actually-use-the-index
Hotfix: actually utilise the new compound index.
2024-02-29 11:32:40 +00:00
iPromKnight
a5bd16e332 update rabbit host in docker-compose 2024-02-29 11:25:22 +00:00
iPromKnight
0f0298887c Change startup url to avoid conflict 2024-02-29 11:23:18 +00:00
iPromKnight
fcc4440a7d small hotfix to use fuzzy text lookups and actually utilise the compound index. 2024-02-29 11:23:18 +00:00
purple_emily
e735c8937a Merge pull request #102 from iPromKnight/rabbit-envvars
BREAKING: Cleanup RabbitMQ env vars, and Github Pat
2024-02-29 10:26:24 +00:00
iPromKnight
36592558b4 stick to 5 digit cron expression 2024-02-28 15:08:12 +00:00
iPromKnight
d0346f29bf Add cleanup of initialize mongodb, ensure indexes are created for compound searching 2024-02-28 14:57:26 +00:00
iPromKnight
1b9a01c677 BREAKING: Cleanup RabbitMQ env vars, and Github Pat 2024-02-28 12:57:55 +00:00
iPromKnight
9f35605e59 Merge pull request #101 from iPromKnight/add-new-mongo-envar
BREAKING: Change mongodb env to be in line with the others
2024-02-28 12:13:57 +00:00
iPromKnight
faad989306 Throw error if new mongo env vars not set in compose 2024-02-28 12:07:46 +00:00
iPromKnight
a25aef8f58 dont restart the metadata service when it completes, and exit if its a single run 2024-02-28 11:51:46 +00:00
iPromKnight
e24fb69dc3 build metadata image 2024-02-28 10:31:39 +00:00
iPromKnight
f8d34a3b90 Add metadata env vars and service 2024-02-28 10:26:10 +00:00
iPromKnight
42f55318e4 change mongodb env var in addon - breaking 2024-02-28 10:16:34 +00:00
iPromKnight
acff67d7ba Cleanup the mongodb env - breaking change
Fixes the consumer tests
2024-02-28 10:14:20 +00:00
Gabisonfire
fc0f6438ba Merge pull request #100 from iPromKnight/add-new-imdbcache-to-consumer
Plug in the new mongo imdb lookups into the consumer
2024-02-28 00:12:27 -05:00
iPromKnight
9c8cbf6468 Plug in the new mongo imdb lookups into the consumer 2024-02-28 04:03:50 +00:00
Gabisonfire
2f795d3455 Merge pull request #99 from iPromKnight/metadata-service
Create service to populate Imdb data collection within mongo
2024-02-27 21:56:08 -05:00
iPromKnight
79d0ef7f4d Create service to populate Imdb data collection within mongo
We can use this collection as an alternative source to lookup imdb ids, which would be executed before name_to_imdb is called in the consumer.
2024-02-27 22:39:19 +00:00
iPromKnight
aad59c31e4 Merge pull request #98 from Gabisonfire/feat/nyaasi
Adds Nyaa Crawler
2024-02-27 17:39:48 +00:00
Gabisonfire
6c4282b6de Adds Nyaa Crawler 2024-02-27 10:08:39 -05:00
Gabisonfire
c7cf84ae62 Updated premiumize moch from upstream 2024-02-27 09:22:50 -05:00
Gabisonfire
4cbbb314b2 Merge pull request #96 from iPromKnight/dmm-gittrees
Fix DMM so that all pages are enumerated
2024-02-27 09:13:40 -05:00
iPromKnight
49a6283f26 Fix DMM so that all pages are enumerated
Fixes #95 by switching to git trees instead of the content api.
2024-02-27 13:51:21 +00:00
Gabisonfire
92dc4c5d66 Merge pull request #94 from aelfa/patch-2
pgrep command is part of the procps package, installed in the builder stage, but it's not present in the final stage.
2024-02-21 08:09:34 -05:00
Aelfa
62380e5f3c pgrep command is part of the procps package, installed in the builder stage, but it's not present in the final stage.
This modification adds the installation of procps in the final stage, ensuring that the pgrep command is available for health check.
2024-02-21 03:58:36 +05:00
Aelfa
0a2c9ad1f0 Update Dockerfile 2024-02-21 03:22:16 +05:00
Gabisonfire
4d862dba83 Merge pull request #90 from Gabisonfire/fix/ga-workflow-latest-tags
Try to fix GitHub action workflow (see #87)
2024-02-20 15:50:26 -05:00
Gabisonfire
9ca14c81e5 Merge pull request #91 from aelfa/patch-1
Resolve "pgrep: not found" issue
2024-02-20 15:49:56 -05:00
Aelfa
496b12c680 Resolve "pgrep: not found" issue
Resolve "pgrep: not found" issue

Added installation of the procps package in the builder stage to ensure the pgrep command is available in the final Docker image. This resolves the "pgrep: not found" issue in the HEALTHCHECK.
2024-02-19 01:31:14 +05:00