knightcrawler/src/producer/Extensions/ConfigureHostBuilderExtensions.cs at ab17ef81be610005049d6ccc8c2a1417d18626b2 - knightcrawler - Caldwell Digital - Gitea

tools/knightcrawler

mirror of https://github.com/knightcrawler-stremio/knightcrawler.git synced 2024-12-20 03:29:51 +00:00

Files

iPromKnight ab17ef81be Big rewrite - distributed consumers for ingestion / scraping(scalable) - single producer written in c#.

Changed from page scraping to rss xml scraping
Includes RealDebridManager hashlist decoding (requires a github readonly PAT as requests must be authenticated) - This allows ingestion of 200k+ entries in a few hours.
Simplifies a lot of torrentio to deal with new data

2024-02-01 16:38:45 +00:00

8 lines

292 B

C#

Raw Blame History

 namespace Scraper.Extensions;
 internal static class ConfigureHostBuilderExtensions
 {
     internal static IHostBuilder SetupSerilog(this ConfigureHostBuilder builder, IConfiguration configuration) =>
         builder.UseSerilog((_, c) =>
             c.ReadFrom.Configuration(configuration));
 }