168 Commits (master)

Author SHA1 Message Date
Jason 5c3b802315 fix server.py 3 years ago
Tanner Collin c9fb9bd5df Add Lobsters to feed 3 years ago
Tanner Collin fd9c9c888d Update gitignore 3 years ago
Jason Schwarzenberger 66a4953b83 add video max-with 3 years ago
Jason Schwarzenberger 4e5dc65461 don't rescrape if simple. 3 years ago
Jason Schwarzenberger 33a25fa34e allow re-scraping if simple scraper was used. 3 years ago
Jason Schwarzenberger da7f6330bf improve meta data scraping. 3 years ago
Jason Schwarzenberger 2a2bf4d671 add excerpt and scraper details. 3 years ago
Jason afe3e08055 etc 3 years ago
Jason Schwarzenberger d1c513b9d6 move purify to server side. 3 years ago
Jason Schwarzenberger e53c5fc904 fix mistake. 3 years ago
Jason Schwarzenberger 59c6f17e67 gotta try this on live. 3 years ago
Jason Schwarzenberger f670479bd7 progress 3 years ago
Jason 085dd47d13 fix tvnz time for nzst/nzdt 3 years ago
Jason Schwarzenberger 72e2232469 fix substack comments. 3 years ago
Jason Schwarzenberger 247715a76e adjust feed thread. 3 years ago
Jason Schwarzenberger 5c96092a57 sort ref_list so newly added is first. 3 years ago
Jason Schwarzenberger bb1413b586 sort substack feed by time. 3 years ago
Jason Schwarzenberger fe01ea52e5 get favicons for custom substack publications. 3 years ago
Jason Schwarzenberger 3daae5fa1b change substack time parsing to misc.time 3 years ago
Jason Schwarzenberger c1b6349771 namespace the refs for hn and substack. 3 years ago
Jason 54a4c7e55a fix with try-catch 3 years ago
Jason b12a3570b0 add logging, extend id length 3 years ago
Jason Schwarzenberger a86eb98c1a fix hn self posts related discussion. 4 years ago
Jason Schwarzenberger abf7f0a802 force reader update in update-story.py 4 years ago
Tanner Collin 42dcf15374 Increase sqlite lock timeout 4 years ago
Tanner Collin d8a0b77765 Blacklist sec.gov website 4 years ago
Jason Schwarzenberger 32bc3b906b add update-story.py 4 years ago
Jason Schwarzenberger f5e65632b8 fix comment date. 4 years ago
Jason Schwarzenberger 1fe524207e stuff comments. 4 years ago
Jason Schwarzenberger 539350a83d port separation. 4 years ago
Jason Schwarzenberger f5b38f5c6b remove readerserver, add declutter. 4 years ago
Jason Schwarzenberger 3b885e4327 renaming things. 4 years ago
Jason Schwarzenberger 5668fa5dbc fix mistake. 4 years ago
Jason Schwarzenberger b771b52501 add regex to get a unique ref from each sitemap/category based article url. 4 years ago
Jason Schwarzenberger f5ccd844da fix import error. 4 years ago
Jason Schwarzenberger 6a91b9402f split categories, sitemap and other crap out of news.py 4 years ago
Jason Schwarzenberger b23e470317 move reddit thresholds as settings variables. 4 years ago
Jason Schwarzenberger 7420b5ece9 fix microdata multiple authors 4 years ago
Jason Schwarzenberger 64ced635cc fix mistake. 4 years ago
Jason Schwarzenberger 9318627f1b ability to pass in multiple site maps/category urls. 4 years ago
Jason Schwarzenberger 3d0a3f1577 support list based json-ld authors. 4 years ago
Jason Schwarzenberger 587b10c438 recursive sitemaps (sitemap indexes) 4 years ago
Jason 00954c6cac local browser scraper 4 years ago
Jason Schwarzenberger 3169af3002 hostname from settings. 4 years ago
Jason Schwarzenberger d588a60930 add source to searchable attributes. 4 years ago
Jason Schwarzenberger 408e2870b2 tzinfo and microdata schema urls. 4 years ago
Jason Schwarzenberger 44b8b36547 add data cast in query. 4 years ago
Jason Schwarzenberger 1d78b1c592 fix favicon url. 4 years ago
Jason Schwarzenberger 0374794536 Sitemap and Category to get favicon into `icon` property of story. 4 years ago