Commit Graph

9 Commits

Author SHA1 Message Date
purple_emily
170d126fc9 Formatting 2024-02-04 16:02:47 +00:00
purple_emily
f4df6e27a7 Close the ports for RabbitMQ 2024-02-04 16:02:47 +00:00
purple_emily
562713f749 Close the MongoDB port 2024-02-04 16:02:23 +00:00
purple_emily
050c22e11e Change wording of security comment 2024-02-04 15:58:10 +00:00
purple_emily
bc2c36b92f Close the external PostgreSQL port 2024-02-04 15:58:10 +00:00
purple_emily
cd3c2d3fe6 Merge and simplify the environment variables in
addon and consumer.

Todo: producer

Change DATABASE_URI to be generic POSTGRES variables

DOES NOT WORK - First pass at upgrading environment variables

PostgreSQL environment variables have been split for addon and consumer. ENABLE_SYNC hard coded as `true`

MongoDB variables update.

Make the addon code more similar to the consumer code

Get some parity between addon and consumer
2024-02-04 08:30:55 +00:00
Gabisonfire
5fe3f471e9 Renames project to Knight Crawler 2024-02-03 23:45:06 -05:00
HDwayne
8e991488ce Add monitoring capabilities with Grafana and Prometheus 2024-02-03 17:09:10 +01:00
iPromKnight
ab17ef81be Big rewrite - distributed consumers for ingestion / scraping(scalable) - single producer written in c#.
Changed from page scraping to rss xml scraping
Includes RealDebridManager hashlist decoding (requires a github readonly PAT as requests must be authenticated) - This allows ingestion of 200k+ entries in a few hours.
Simplifies a lot of torrentio to deal with new data
2024-02-01 16:38:45 +00:00