Sleeyax
7d5fbb2871
Center logo and introduction ( #116 )
...
* Center logo and introduction
* Update README.md
2024-03-05 09:07:03 +00:00
ben-2357
af274df047
Change docker-compose to docker compose
2024-03-04 22:10:54 -06:00
ben-2357
186cd8be36
Update README.md
2024-03-04 21:54:14 -06:00
ben-2357
32fc0721dc
Made run steps easier to understand
2024-03-04 21:52:40 -06:00
ben-2357
35c54acd00
Update README.md
2024-03-04 21:48:17 -06:00
ben-2357
d7e68446b5
Update README.md
2024-03-04 21:45:34 -06:00
ben-2357
87cb085c3a
Update README.md
2024-03-04 21:44:13 -06:00
ben-2357
c065ad024f
Added direction for uncommenting Caddy
2024-03-04 21:31:30 -06:00
ben-2357
b6bfa0723a
Fixed typos and added an additional message describing security vulnerabilities associated with forwarding ports.
2024-03-04 21:19:12 -06:00
ben-2357
6f3315ae0f
Update README.md
2024-03-04 13:00:39 -06:00
ben-2357
c64ca7bce4
Update README.md
2024-03-04 12:58:17 -06:00
ben-2357
6af0e6d9f5
Update README.md
2024-03-04 12:54:04 -06:00
ben-2357
4fdbb6679a
Update README.md
2024-03-04 12:52:01 -06:00
ben-2357
7333aa1d73
Update README.md
2024-03-04 12:51:23 -06:00
Gabisonfire
d54b5dbc33
New logo
2024-03-03 19:09:38 -05:00
purple_emily
8f16cb0424
Bugfix: two movie commands instead of movie and tv
2024-02-08 20:56:00 +00:00
purple_emily
672a28bc6f
Reword the instructions for importing sqlite databases
2024-02-08 12:42:30 +00:00
funkecoder23
b0bc4f41ad
add info about fixing incorrect imports
2024-02-07 17:59:18 -05:00
funkecoder23
2dfe850e0c
Add psql command for inserting non-exact movies and tv categories
2024-02-06 23:33:46 -05:00
Gabisonfire
81c02b0c96
Merge pull request #77 from trulow/patch-1
...
Added alternative pgloader process using docker
2024-02-06 15:53:12 -05:00
NebKi
741ef4c5a9
Change SQL command to import all movies and tv categories and skip duplicates
2024-02-06 11:09:17 +01:00
trulow
edb3d1ded7
Update README.md
...
Fixed network for docker pgloader
2024-02-06 02:01:04 -08:00
trulow
d40a551f8f
Added alternative pgloader process using docker
...
I added an alternative method of using pgloader leveraging docker entirely.
2024-02-06 01:56:17 -08:00
Gabisonfire
2ece56d7e1
Update README.md
...
Moved discord link
2024-02-05 08:37:10 -05:00
Gabisonfire
3e43a6f0ff
Update README.md
...
Added Discord link
2024-02-05 08:36:25 -05:00
funkecoder23
73cf835105
add information on dropping items table after import
2024-02-04 21:03:15 -05:00
funkecoder23
46da28f10c
change .env path to match new location
2024-02-04 20:37:25 -05:00
funkecoder23
2d27926816
correct the psql command
...
escaped quotes to properly parse the "createdAt" and "updatedAt" column names
2024-02-04 20:29:28 -05:00
funkecoder23
101b5c416e
Add optional configuration section
...
Add details about consumer replicas
Add CONSUMER_REPLICAS to .env.example
Change `consumer: deploy: replicas` to use CONSUMER_REPLICAS var to keep user config options in one file
2024-02-04 20:29:28 -05:00
funkecoder23
2593bbdb73
update readme with more info
...
add info about installing docker
update DMM setup with correct path for env
reorder env setup and DMM setup
add info about pgloader and combine SQL command command into a docker exec
use github markdown for notes and important info
2024-02-04 20:29:06 -05:00
iPromKnight
b773ffcb20
Logging expansion
...
Adds Promtail and Loki to the metrics stack, configuring them as a datasource in grafana on deployment
Adds a dashboard to monitor the system (logs for producer and consumer)
Restructures the base directory so deployment manifests are moved into a deployments folder
Adds selective labels to producer, consumer and addon so that their logs are ingested by promtail
2024-02-04 19:50:28 +00:00
iPromKnight
7ba38db0cc
remove .env and add .env.example - add readme instructions
2024-02-04 15:45:32 +00:00
Gabisonfire
5fe3f471e9
Renames project to Knight Crawler
2024-02-03 23:45:06 -05:00
HDwayne
45e17799b2
Add monitoring for Postgres metrics in README
2024-02-04 01:29:55 +01:00
HDwayne
679a658463
Fix docker-compose command in README
2024-02-03 17:17:13 +01:00
HDwayne
8e991488ce
Add monitoring capabilities with Grafana and Prometheus
2024-02-03 17:09:10 +01:00
David Young
679bba3030
Minimal docs on importing rarbg dump
...
Signed-off-by: David Young <davidy@funkypenguin.co.nz >
2024-02-03 23:07:12 +13:00
purple_emily
1a71d618bd
Add a simple to do list
2024-02-02 15:40:12 +00:00
purple_emily
428bdff413
Added a section on how to generate a GitHub PAT
2024-02-02 15:37:01 +00:00
purple_emily
2ddd30f621
Add an overview section to the README
2024-02-02 15:04:00 +00:00
iPromKnight
ab17ef81be
Big rewrite - distributed consumers for ingestion / scraping(scalable) - single producer written in c#.
...
Changed from page scraping to rss xml scraping
Includes RealDebridManager hashlist decoding (requires a github readonly PAT as requests must be authenticated) - This allows ingestion of 200k+ entries in a few hours.
Simplifies a lot of torrentio to deal with new data
2024-02-01 16:38:45 +00:00
iPromKnight
da997af64a
Move compose to top level
...
Comment out broken scrapers
Remove db init scripts and use ENABLE_SYNC env var which the code base uses to specify if Sequelize should create or alter tables on startup, meaning we dont need manual db initialization. There were missing tables anyhow :P
2024-01-18 08:54:57 +00:00
Gabisonfire
a34e40fbc8
First self-hosted release
2024-01-17 00:27:03 -05:00
TheBeastLT
cef5d33d84
fi readme
2022-06-17 22:07:23 +03:00
TheBeastLT
cf83b4f17b
adjust enabled sscrapers
2022-06-17 07:13:56 +03:00
TheBeastLT
a253e8e0b0
remove scraper
2022-06-16 17:43:27 +03:00
TheBeastLT
58aba322c2
moves scraper to a subpackage
2020-03-10 15:23:52 +01:00
TheBeastLT
2618694e33
adds rarbg dump scraper based on scraped imdb ids
2020-03-09 15:23:16 +01:00
TheBeastLT
0f91c98b84
refactors scrapers and add kat and unofficial tpb dump scraper
2020-02-23 23:18:58 +01:00
TheBeastLT
5a122683d7
Initial commit
2019-03-13 22:41:15 +01:00
