Gabisonfire
fd03760155
Add issues template
2024-02-02 10:13:00 -05:00
Gabisonfire
6fb4ddcf23
Merge pull request #20 from Gabisonfire/devel
...
Sync with upstream
2024-01-31 20:29:43 -05:00
Gabisonfire
b2bba2a8aa
Sync with upstream
2024-01-31 19:53:47 -05:00
Gabisonfire
d63f1d9716
Merge pull request #19 from KillTrot/master
...
Change 1337x FlareSolverr mechanic to only use FlareSolverr on the first request
2024-01-31 16:12:44 -05:00
Cedric
a0017f3491
Merge branch 'Gabisonfire:master' into master
2024-01-31 15:00:28 -06:00
Cedric
3f6c95b12f
Remove FlareSolverr Variables after scraping
2024-01-31 14:59:41 -06:00
Cedric
aa101758f0
Merge branch 'master' of https://github.com/KillTrot/torrentio-scraper-sh
2024-01-31 14:21:48 -06:00
Cedric
ee34b6db17
Change Flaresolverr mechanic to use cookies after initial flaresolverr request
2024-01-31 14:19:46 -06:00
TheBeastLT
fb267b8057
remove psql logging
2024-01-31 09:30:59 +02:00
TheBeastLT
79b83e52e4
reduce psql connection pool a bit
2024-01-31 09:25:33 +02:00
TheBeastLT
ebf2934c6c
cache resolve url in remote mongo and reduce cache time
2024-01-31 09:24:31 +02:00
TheBeastLT
11e86c3cdc
increase RD timeout
2024-01-30 09:19:57 +02:00
TheBeastLT
aaa48f585c
update deploy workflow
2024-01-30 09:04:57 +02:00
TheBeastLT
fb8148a737
update deploy workflow
2024-01-30 08:58:45 +02:00
TheBeastLT
cca0331caa
remove bottleneck
2024-01-30 08:56:27 +02:00
TheBeastLT
85d9f3d406
update deploy workflow
2024-01-30 08:55:17 +02:00
TheBeastLT
ae955e6634
update deploy workflow
2024-01-30 08:50:12 +02:00
TheBeastLT
cc0d8cbdab
bump node base image to 21
2024-01-30 08:49:58 +02:00
Gabisonfire
3556821253
Merge pull request #15 from KillTrot/master
...
Add FlareSolverr fro 1337x
2024-01-29 10:49:30 -05:00
Cedric
21e8b628ef
Update docker-compose.yml
2024-01-29 09:16:50 -06:00
Cedric
07d4d020e6
Added FlareSolverr fro 1337x
2024-01-29 09:15:46 -06:00
Gabisonfire
85af1bb66d
Merge pull request #10 from trulow/master
...
Added depends on to docker-compose.yml
2024-01-28 16:37:12 -05:00
TheBeastLT
81218bbc8d
increase mongo connection pool
2024-01-28 21:44:54 +02:00
TheBeastLT
3bf13e68ba
try use p-limit instead of bottleneck
2024-01-28 02:12:41 +02:00
trulow
ebd97eb250
Added depends on to docker-compose.yml
...
Added the following lines to both scraper and torrentio services
depends_on:
- mongodb
- postgres
2024-01-26 11:05:12 -08:00
Gabisonfire
7bddd41fac
Merge branch 'TheBeastLT:master' into master
2024-01-25 21:27:58 -05:00
TheBeastLT
64b8a55f3b
do not limit stream request named queue
2024-01-26 01:30:25 +02:00
TheBeastLT
9366ad1ccb
fix request named queue
2024-01-26 01:20:35 +02:00
TheBeastLT
4681cb1f1b
add named queue for stream requests
2024-01-26 01:12:44 +02:00
TheBeastLT
af7511a610
export named queue creation
2024-01-26 01:12:02 +02:00
TheBeastLT
0a06018f83
reduce limiter concurrent
2024-01-26 00:27:17 +02:00
TheBeastLT
3f1624cd8e
add temp logging
2024-01-26 00:14:52 +02:00
TheBeastLT
a71a846dbd
bring back sw stats
2024-01-26 00:09:18 +02:00
TheBeastLT
a22d7d4b10
improve psql pool config
2024-01-22 21:58:53 +02:00
Gabisonfire
741dbfb55a
Merge branch 'TheBeastLT:master' into master
2024-01-22 09:24:25 -05:00
TheBeastLT
0fdc968a86
remove psql pool evict
2024-01-22 00:13:27 +02:00
TheBeastLT
a51ddc53c5
revert bypassing mongo
2024-01-21 23:46:15 +02:00
TheBeastLT
f22df6c5cb
try to test bypassing mongo
2024-01-21 23:36:07 +02:00
TheBeastLT
1572ae4af5
add psql pool config
2024-01-21 23:31:58 +02:00
TheBeastLT
777241fdfa
add mongo pool size
2024-01-21 23:25:07 +02:00
TheBeastLT
4ee220a1ad
move limiter before mongo call
2024-01-21 23:14:44 +02:00
TheBeastLT
8a4eb4cdfe
add limiter options
2024-01-19 10:30:13 +02:00
Gabisonfire
dd0beb5973
fix merge conflicts
2024-01-19 00:39:26 -05:00
Gabisonfire
c5118475dd
updated urls for torrent9
2024-01-19 00:38:00 -05:00
Gabisonfire
e0b07ba363
updated urls for torrent9
2024-01-18 07:34:09 -05:00
iPromKnight
da997af64a
Move compose to top level
...
Comment out broken scrapers
Remove db init scripts and use ENABLE_SYNC env var which the code base uses to specify if Sequelize should create or alter tables on startup, meaning we dont need manual db initialization. There were missing tables anyhow :P
2024-01-18 08:54:57 +00:00
Gabisonfire
2351d92885
Updated scrapers to latest available commit
2024-01-17 18:22:01 -05:00
Gabisonfire
909ade0d8e
Updated scrapers to latest available commit
2024-01-17 16:43:58 -05:00
Gabisonfire
cab7f38c66
Added back original scrapers, integrated with PGSQL
2024-01-17 16:20:00 -05:00
Gabisonfire
364d1545b1
Wrapped try except for link processing
2024-01-17 09:37:52 -05:00
