tools/knightcrawler
1
0
Fork 0
mirror of https://github.com/knightcrawler-stremio/knightcrawler.git synced 2024-12-20 03:29:51 +00:00
Code Issues Actions Packages Projects Releases Wiki Activity
878 Commits 7 Branches 31 Tags
2ece56d7e148579dcfd511ece09f3c2ca3f8837a
Commit Graph

878 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Gabisonfire
2ece56d7e1 Update README.md 
Moved discord link
 2024-02-05 08:37:10 -05:00
Gabisonfire
3e43a6f0ff Update README.md 
Added Discord link
 2024-02-05 08:36:25 -05:00
Gabisonfire
6bdc5d644f Merge pull request #67 from Gabisonfire/feat/build_workflow 
Image build action
 2024-02-05 08:22:13 -05:00
Gabisonfire
6813c755ea Merge pull request #68 from FunkeCoder23/66-remove-sync-alter 
Remove alter param from database sync
 2024-02-05 08:14:29 -05:00
purple_emily
143754f36f BUGFIX: Change POSTGRES_DATABASE to POSTGRES_DB 2024-02-05 12:49:19 +00:00
purple_emily
0a0ad800fc BUGFIX: Change POSTGRES_USERNAME to POSTGRES_USER. Oops 2024-02-05 11:44:39 +00:00
purple_emily
287507d8e0 Add alter param back to database sync. Default to false. Make toggleable from .env file. 2024-02-05 10:43:20 +00:00
funkecoder23
ecdae702ad Remove alter param from database sync 
Re: [sequelize docs](https://sequelize.org/docs/v6/core-concepts/model-basics/#synchronization-in-production)
Alter is a bad idea in production.

Also print error message instead of sequelize error object as it's a bit verbose
 2024-02-04 23:23:57 -05:00
Gabisonfire
32dced5f72 Builds and pushes various components images 2024-02-04 21:49:29 -05:00
Gabisonfire
2c41657d25 Builds and pushes various components images 2024-02-04 21:35:16 -05:00
Gabisonfire
c7aa5732a9 Merge pull request #59 from FunkeCoder23/docs-update 
Update readme with more info
 2024-02-04 21:05:12 -05:00
funkecoder23
73cf835105 add information on dropping items table after import 2024-02-04 21:03:15 -05:00
funkecoder23
46da28f10c change .env path to match new location 2024-02-04 20:37:25 -05:00
funkecoder23
2d27926816 correct the psql command 
escaped quotes to properly parse the "createdAt" and "updatedAt" column names
 2024-02-04 20:29:28 -05:00
funkecoder23
101b5c416e Add optional configuration section 
Add details about consumer replicas

Add CONSUMER_REPLICAS to .env.example

Change `consumer: deploy: replicas` to use CONSUMER_REPLICAS var to keep user config options in one file
 2024-02-04 20:29:28 -05:00
funkecoder23
2593bbdb73 update readme with more info 
add info about installing docker

update DMM setup with correct path for env

reorder env setup and DMM setup

add info about pgloader and combine SQL command command into a docker exec

use github markdown for notes and important info
 2024-02-04 20:29:06 -05:00
Gabisonfire
24f35d10db Merge pull request #64 from trulow/patch-2 
Updated and replaced selfhostio entries with knightcrawler
 2024-02-04 20:06:48 -05:00
Gabisonfire
469f643526 Merge pull request #58 from iPromKnight/promtail-loki 
Logging expansion
 2024-02-04 20:03:09 -05:00
trulow
d4e82e9878 Updated and replaced selfhostio entries with knightcrawler 
Updated and replaced selfhostio entries with knightcrawler.

Was previously still pointing to the old DB name of selfhostio
 2024-02-04 16:52:05 -08:00
purple_emily
6e362cfb89 Merge pull request #62 from FunkeCoder23/hotfix-manifest-version 2024-02-04 22:30:15 +00:00
funkecoder23
3ddc922081 remove extraneous v from manifest version 2024-02-04 17:19:11 -05:00
iPromKnight
dae52c1bc4 forgot to update paths - doh 2024-02-04 20:32:08 +00:00
iPromKnight
b773ffcb20 Logging expansion 
Adds Promtail and Loki to the metrics stack, configuring them as a datasource in grafana on deployment
Adds a dashboard to monitor the system (logs for producer and consumer)
Restructures the base directory so deployment manifests are moved into a deployments folder
Adds selective labels to producer, consumer and addon so that their logs are ingested by promtail
 2024-02-04 19:50:28 +00:00
iPromKnight
eef3265850 Merge pull request #55 from Gabisonfire/critical-security-enhancements 
Critical security enhancements
 2024-02-04 16:04:42 +00:00
iPromKnight
2b715b90a7 Remove postgres exporter port bind 2024-02-04 16:02:47 +00:00
purple_emily
170d126fc9 Formatting 2024-02-04 16:02:47 +00:00
purple_emily
f4df6e27a7 Close the ports for RabbitMQ 2024-02-04 16:02:47 +00:00
purple_emily
562713f749 Close the MongoDB port 2024-02-04 16:02:23 +00:00
purple_emily
050c22e11e Change wording of security comment 2024-02-04 15:58:10 +00:00
purple_emily
bc2c36b92f Close the external PostgreSQL port 2024-02-04 15:58:10 +00:00
iPromKnight
875d79b44d Merge pull request #46 from purple-emily/change-to-single-env-file 
Simplify the environment variables
 2024-02-04 15:56:25 +00:00
iPromKnight
7ba38db0cc remove .env and add .env.example - add readme instructions 2024-02-04 15:45:32 +00:00
iPromKnight
e461e26b0f Change postgres configuration in the producer to use the env vars from the stack 2024-02-04 15:03:07 +00:00
purple_emily
c20a92e8f0 Remove old environment files 2024-02-04 08:34:49 +00:00
purple_emily
cd3c2d3fe6 Merge and simplify the environment variables in 
addon and consumer.

Todo: producer

Change DATABASE_URI to be generic POSTGRES variables

DOES NOT WORK - First pass at upgrading environment variables

PostgreSQL environment variables have been split for addon and consumer. ENABLE_SYNC hard coded as `true`

MongoDB variables update.

Make the addon code more similar to the consumer code

Get some parity between addon and consumer
 2024-02-04 08:30:55 +00:00
purple_emily
b7c3c4376b Merge pull request #51 from Gabisonfire/feat/renaming 
Renames project to Knight Crawler
 2024-02-04 08:30:24 +00:00
Gabisonfire
5fe3f471e9 Renames project to Knight Crawler 2024-02-03 23:45:06 -05:00
Gabisonfire
a8173a0ba7 Merge pull request #48 from HDwayne/master 
Monitoring with Grafana and Prometheus
 2024-02-03 19:42:49 -05:00
Gabisonfire
adcf911d10 Merge pull request #49 from iPromKnight/master 
Package updates and start of logging
 2024-02-03 19:38:52 -05:00
HDwayne
45e17799b2 Add monitoring for Postgres metrics in README 2024-02-04 01:29:55 +01:00
HDwayne
5f691ef877 Add Postgres exporter service 2024-02-04 01:18:34 +01:00
iPromKnight
d660a72d6f missed a couple of log lines for logger 2024-02-03 22:12:45 +00:00
iPromKnight
8c1b6fc91b roll logging levels out throughout the consumer 2024-02-03 22:06:38 +00:00
iPromKnight
4bd76d682f remove pm2 process manager - let the container orchestrator handle the lifetime events (docker, podman, k8s etc) 2024-02-03 22:06:02 +00:00
iPromKnight
678b3857f3 Add pino as a logger, and update cache manager 
Rewrites the cache service to use the latest implementation of cache manager, and bring in the new mongo package.
Introduce Logger service
Removes bluebird as a dependency
 2024-02-03 22:05:15 +00:00
HDwayne
a56b04f04b Add Temporary statistics endpoint 2024-02-03 22:06:13 +01:00
HDwayne
679a658463 Fix docker-compose command in README 2024-02-03 17:17:13 +01:00
HDwayne
8e991488ce Add monitoring capabilities with Grafana and Prometheus 2024-02-03 17:09:10 +01:00
Gabisonfire
f9746af9cd Merge pull request #47 from geek-cookbook/add-rarbg-docs 
Minimal docs on importing rarbg dump
 2024-02-03 07:43:00 -05:00
David Young
679bba3030 Minimal docs on importing rarbg dump 
Signed-off-by: David Young <davidy@funkypenguin.co.nz>
 2024-02-03 23:07:12 +13:00