136 Commits (e0960d59f33363e1ae60250161d35ceefe1700fa)

Author SHA1 Message Date
Jason Schwarzenberger f5b38f5c6b remove readerserver, add declutter. 4 years ago
Jason Schwarzenberger 3b885e4327 renaming things. 4 years ago
Jason Schwarzenberger 5668fa5dbc fix mistake. 4 years ago
Jason Schwarzenberger b771b52501 add regex to get a unique ref from each sitemap/category based article url. 4 years ago
Jason Schwarzenberger f5ccd844da fix import error. 4 years ago
Jason Schwarzenberger 6a91b9402f split categories, sitemap and other crap out of news.py 4 years ago
Jason Schwarzenberger b23e470317 move reddit thresholds as settings variables. 4 years ago
Jason Schwarzenberger 7420b5ece9 fix microdata multiple authors 4 years ago
Jason Schwarzenberger 64ced635cc fix mistake. 4 years ago
Jason Schwarzenberger 9318627f1b ability to pass in multiple site maps/category urls. 4 years ago
Jason Schwarzenberger 3d0a3f1577 support list based json-ld authors. 4 years ago
Jason Schwarzenberger 587b10c438 recursive sitemaps (sitemap indexes) 4 years ago
Jason 00954c6cac local browser scraper 4 years ago
Jason Schwarzenberger 3169af3002 hostname from settings. 4 years ago
Jason Schwarzenberger d588a60930 add source to searchable attributes. 4 years ago
Jason Schwarzenberger 408e2870b2 tzinfo and microdata schema urls. 4 years ago
Jason Schwarzenberger 44b8b36547 add data cast in query. 4 years ago
Jason Schwarzenberger 1d78b1c592 fix favicon url. 4 years ago
Jason Schwarzenberger 0374794536 Sitemap and Category to get favicon into `icon` property of story. 4 years ago
Jason Schwarzenberger 5efc6ef2d3 add related stories (in api only) 4 years ago
Jason Schwarzenberger 4ec50e20cb feed thread loop. 4 years ago
Jason Schwarzenberger c1b7877f4b remove limit. 4 years ago
Jason Schwarzenberger 7b8cbfc9b9 try to make feed only determined by the max age. 4 years ago
Jason Schwarzenberger 0bd0d40a31 use json type in sqlite. 4 years ago
Jason Schwarzenberger 4e04595415 fix search. 4 years ago
Jason 006db2960c change to 3 days 4 years ago
Jason Schwarzenberger 1f063f0dac undo log level change 4 years ago
Jason Schwarzenberger 1658346aa9 fix news.py feed. 4 years ago
Jason Schwarzenberger 2dbc702b40 switch to python-dateutil for parser, reverse sort xml feeds. 4 years ago
Jason Schwarzenberger 1c4764e67d sort sitemap feed by lastmod time. 4 years ago
Jason ee49d2021e newsroom 4 years ago
Jason c391c50ab1 use localize 4 years ago
Jason Schwarzenberger 095f0d549a use replace. 4 years ago
Jason Schwarzenberger c21c71667e fix date issue. 4 years ago
Jason Schwarzenberger c3a2c91a11 update requirements.txt 4 years ago
Jason Schwarzenberger 0f39446a61 tz aware for use in settings. 4 years ago
Jason Schwarzenberger 351059aab1 fix excludes. 4 years ago
Jason Schwarzenberger 4488e2c292 add an `excludes` list of substrings for urls in the settings for sitemap/category. 4 years ago
Jason Schwarzenberger afda5b635c disqus test. 4 years ago
Jason Schwarzenberger 0fc1a44d2b fix issue in substack. 4 years ago
Jason Schwarzenberger 9fff1b9e46 avoid duplicate articles listed on the category page 4 years ago
Jason Schwarzenberger 16b59f6c67 try stop bad pages. 4 years ago
Jason Schwarzenberger 939f4775a7 better settings example. 4 years ago
Jason Schwarzenberger 9bfc6fc6fa scraper settings, ordering and loop. 4 years ago
Jason Schwarzenberger 6ea9844d00 remove useless try blocks. 4 years ago
Jason Schwarzenberger 1318259d3d imply referrer is substack. 4 years ago
Jason Schwarzenberger 98a0c2257c increase declutter timeout. 4 years ago
Jason Schwarzenberger e6976db25d fix tabs 4 years ago
Jason Schwarzenberger 9edc8b7cca move scraping for article content to files. 4 years ago
Jason Schwarzenberger d718d05a04 fix dates for newsroom. 4 years ago