Go to file

iPromKnight 57f4757541 Implement Max Queue and Max Batch size when publishing

MaxPublishBatchSize must be set, but MaxQueueSize can be set to 0 to disable check of the rabbitmq queue size

2024-02-02 14:43:29 +00:00

env

Implement Max Queue and Max Batch size when publishing

2024-02-02 14:43:29 +00:00

src

Implement Max Queue and Max Batch size when publishing

2024-02-02 14:43:29 +00:00

.dockerignore

fix catalogs dockerfile

2022-04-01 14:20:32 +02:00

.editorconfig

Add editor config

2024-02-02 13:25:57 +00:00

.gitignore

harden consumer

2024-02-02 14:04:53 +00:00

docker-compose.yaml

Big rewrite - distributed consumers for ingestion / scraping(scalable) - single producer written in c#.

2024-02-01 16:38:45 +00:00

LICENSE

Initial commit

2019-03-13 22:25:05 +01:00

README.md

Big rewrite - distributed consumers for ingestion / scraping(scalable) - single producer written in c#.

2024-02-01 16:38:45 +00:00

README.md

Torrentio

torrentio-addon - the Stremio addon which will query scraped entries and return Stremio stream results.

Self-hosted quickstart

docker-compose up -d

Then open your browser to 127.0.0.1:7000

If you'd like to enable crawling of RealDebridManager's shared hashlists which will massively boost your database cached entries, enter a readonly github personal access token in 'env/producer.env' as the 'GithubSettings__PAT=<token_here>' value.

You can scale the number of consumers, by changing the consumer deploy replica count in the compose file on line 87. This is currently set to 3. If you'd like to adjust the number of concurrent processed ingestions per consumer, thats the job concurrency setting within 'env/consumer.env'.

Languages

JavaScript 49.4%

C# 46%

PLpgSQL 1.8%

Python 1.3%

Dockerfile 1.3%

Other 0.1%