David Young
8c39b36911
Fix addon collection name
...
Signed-off-by: David Young <davidy@funkypenguin.co.nz >
2024-02-08 13:41:39 +13:00
funkecoder23
b0bc4f41ad
add info about fixing incorrect imports
2024-02-07 17:59:18 -05:00
funkecoder23
2dfe850e0c
Add psql command for inserting non-exact movies and tv categories
2024-02-06 23:33:46 -05:00
Gabisonfire
81c02b0c96
Merge pull request #77 from trulow/patch-1
...
Added alternative pgloader process using docker
2024-02-06 15:53:12 -05:00
Gabisonfire
6f1226e6fc
Merge pull request #78 from NebKi/master
...
Change SQL command to insert all movies and tv categories + skip duplicates
2024-02-06 15:52:40 -05:00
NebKi
741ef4c5a9
Change SQL command to import all movies and tv categories and skip duplicates
2024-02-06 11:09:17 +01:00
trulow
edb3d1ded7
Update README.md
...
Fixed network for docker pgloader
2024-02-06 02:01:04 -08:00
trulow
d40a551f8f
Added alternative pgloader process using docker
...
I added an alternative method of using pgloader leveraging docker entirely.
2024-02-06 01:56:17 -08:00
Gabisonfire
0a71104124
Merge pull request #76 from FunkeCoder23/75-keep-queue-on-down
...
Add hostname to rabbit mq container
2024-02-05 22:43:40 -05:00
funkecoder23
0b8e03e1d8
Add hostname to rabbit mq container
...
RabbitMQ needs a persistent hostname per https://github.com/docker-library/rabbitmq/issues/392 otherwise it starts with a random one, losing data
2024-02-05 20:08:52 -05:00
Gabisonfire
2ece56d7e1
Update README.md
...
Moved discord link
2024-02-05 08:37:10 -05:00
Gabisonfire
3e43a6f0ff
Update README.md
...
Added Discord link
2024-02-05 08:36:25 -05:00
Gabisonfire
6bdc5d644f
Merge pull request #67 from Gabisonfire/feat/build_workflow
...
Image build action
2024-02-05 08:22:13 -05:00
Gabisonfire
6813c755ea
Merge pull request #68 from FunkeCoder23/66-remove-sync-alter
...
Remove alter param from database sync
2024-02-05 08:14:29 -05:00
purple_emily
143754f36f
BUGFIX: Change POSTGRES_DATABASE to POSTGRES_DB
2024-02-05 12:49:19 +00:00
purple_emily
0a0ad800fc
BUGFIX: Change POSTGRES_USERNAME to POSTGRES_USER. Oops
2024-02-05 11:44:39 +00:00
purple_emily
287507d8e0
Add alter param back to database sync. Default to false. Make toggleable from .env file.
2024-02-05 10:43:20 +00:00
funkecoder23
ecdae702ad
Remove alter param from database sync
...
Re: [sequelize docs](https://sequelize.org/docs/v6/core-concepts/model-basics/#synchronization-in-production )
Alter is a bad idea in production.
Also print error message instead of sequelize error object as it's a bit verbose
2024-02-04 23:23:57 -05:00
Gabisonfire
32dced5f72
Builds and pushes various components images
2024-02-04 21:49:29 -05:00
Gabisonfire
2c41657d25
Builds and pushes various components images
2024-02-04 21:35:16 -05:00
Gabisonfire
c7aa5732a9
Merge pull request #59 from FunkeCoder23/docs-update
...
Update readme with more info
2024-02-04 21:05:12 -05:00
funkecoder23
73cf835105
add information on dropping items table after import
2024-02-04 21:03:15 -05:00
funkecoder23
46da28f10c
change .env path to match new location
2024-02-04 20:37:25 -05:00
funkecoder23
2d27926816
correct the psql command
...
escaped quotes to properly parse the "createdAt" and "updatedAt" column names
2024-02-04 20:29:28 -05:00
funkecoder23
101b5c416e
Add optional configuration section
...
Add details about consumer replicas
Add CONSUMER_REPLICAS to .env.example
Change `consumer: deploy: replicas` to use CONSUMER_REPLICAS var to keep user config options in one file
2024-02-04 20:29:28 -05:00
funkecoder23
2593bbdb73
update readme with more info
...
add info about installing docker
update DMM setup with correct path for env
reorder env setup and DMM setup
add info about pgloader and combine SQL command command into a docker exec
use github markdown for notes and important info
2024-02-04 20:29:06 -05:00
Gabisonfire
24f35d10db
Merge pull request #64 from trulow/patch-2
...
Updated and replaced selfhostio entries with knightcrawler
2024-02-04 20:06:48 -05:00
Gabisonfire
469f643526
Merge pull request #58 from iPromKnight/promtail-loki
...
Logging expansion
2024-02-04 20:03:09 -05:00
trulow
d4e82e9878
Updated and replaced selfhostio entries with knightcrawler
...
Updated and replaced selfhostio entries with knightcrawler.
Was previously still pointing to the old DB name of selfhostio
2024-02-04 16:52:05 -08:00
purple_emily
6e362cfb89
Merge pull request #62 from FunkeCoder23/hotfix-manifest-version
2024-02-04 22:30:15 +00:00
funkecoder23
3ddc922081
remove extraneous v from manifest version
2024-02-04 17:19:11 -05:00
iPromKnight
dae52c1bc4
forgot to update paths - doh
2024-02-04 20:32:08 +00:00
iPromKnight
b773ffcb20
Logging expansion
...
Adds Promtail and Loki to the metrics stack, configuring them as a datasource in grafana on deployment
Adds a dashboard to monitor the system (logs for producer and consumer)
Restructures the base directory so deployment manifests are moved into a deployments folder
Adds selective labels to producer, consumer and addon so that their logs are ingested by promtail
2024-02-04 19:50:28 +00:00
iPromKnight
eef3265850
Merge pull request #55 from Gabisonfire/critical-security-enhancements
...
Critical security enhancements
2024-02-04 16:04:42 +00:00
iPromKnight
2b715b90a7
Remove postgres exporter port bind
2024-02-04 16:02:47 +00:00
purple_emily
170d126fc9
Formatting
2024-02-04 16:02:47 +00:00
purple_emily
f4df6e27a7
Close the ports for RabbitMQ
2024-02-04 16:02:47 +00:00
purple_emily
562713f749
Close the MongoDB port
2024-02-04 16:02:23 +00:00
purple_emily
050c22e11e
Change wording of security comment
2024-02-04 15:58:10 +00:00
purple_emily
bc2c36b92f
Close the external PostgreSQL port
2024-02-04 15:58:10 +00:00
iPromKnight
875d79b44d
Merge pull request #46 from purple-emily/change-to-single-env-file
...
Simplify the environment variables
2024-02-04 15:56:25 +00:00
iPromKnight
7ba38db0cc
remove .env and add .env.example - add readme instructions
2024-02-04 15:45:32 +00:00
iPromKnight
e461e26b0f
Change postgres configuration in the producer to use the env vars from the stack
2024-02-04 15:03:07 +00:00
purple_emily
c20a92e8f0
Remove old environment files
2024-02-04 08:34:49 +00:00
purple_emily
cd3c2d3fe6
Merge and simplify the environment variables in
...
addon and consumer.
Todo: producer
Change DATABASE_URI to be generic POSTGRES variables
DOES NOT WORK - First pass at upgrading environment variables
PostgreSQL environment variables have been split for addon and consumer. ENABLE_SYNC hard coded as `true`
MongoDB variables update.
Make the addon code more similar to the consumer code
Get some parity between addon and consumer
2024-02-04 08:30:55 +00:00
purple_emily
b7c3c4376b
Merge pull request #51 from Gabisonfire/feat/renaming
...
Renames project to Knight Crawler
2024-02-04 08:30:24 +00:00
Gabisonfire
5fe3f471e9
Renames project to Knight Crawler
2024-02-03 23:45:06 -05:00
Gabisonfire
a8173a0ba7
Merge pull request #48 from HDwayne/master
...
Monitoring with Grafana and Prometheus
2024-02-03 19:42:49 -05:00
Gabisonfire
adcf911d10
Merge pull request #49 from iPromKnight/master
...
Package updates and start of logging
2024-02-03 19:38:52 -05:00
HDwayne
45e17799b2
Add monitoring for Postgres metrics in README
2024-02-04 01:29:55 +01:00
