Commit Graph

61 Commits

Author SHA1 Message Date
Jason Schwarzenberger 408e2870b2 tzinfo and microdata schema urls. 2020-11-10 16:51:27 +13:00
Jason Schwarzenberger 1d78b1c592 fix favicon url. 2020-11-10 15:34:21 +13:00
Jason Schwarzenberger 0374794536 Sitemap and Category to get favicon into icon property of story. 2020-11-10 15:22:27 +13:00
Jason Schwarzenberger 5efc6ef2d3 add related stories (in api only) 2020-11-10 14:09:56 +13:00
Jason Schwarzenberger 1f063f0dac undo log level change 2020-11-06 11:20:34 +13:00
Jason Schwarzenberger 1658346aa9 fix news.py feed. 2020-11-06 10:37:43 +13:00
Jason Schwarzenberger 2dbc702b40 switch to python-dateutil for parser, reverse sort xml feeds. 2020-11-06 10:02:39 +13:00
Jason Schwarzenberger 1c4764e67d sort sitemap feed by lastmod time. 2020-11-06 09:30:15 +13:00
Jason ee49d2021e newsroom 2020-11-05 20:28:55 +00:00
Jason c391c50ab1 use localize 2020-11-05 04:15:31 +00:00
Jason Schwarzenberger 095f0d549a use replace. 2020-11-05 16:57:08 +13:00
Jason Schwarzenberger c21c71667e fix date issue. 2020-11-05 16:41:15 +13:00
Jason Schwarzenberger 0f39446a61 tz aware for use in settings. 2020-11-05 16:30:55 +13:00
Jason Schwarzenberger 351059aab1 fix excludes. 2020-11-05 15:59:13 +13:00
Jason Schwarzenberger 4488e2c292 add an excludes list of substrings for urls in the settings for sitemap/category. 2020-11-05 15:51:59 +13:00
Jason Schwarzenberger afda5b635c disqus test. 2020-11-05 14:23:51 +13:00
Jason Schwarzenberger 0fc1a44d2b fix issue in substack. 2020-11-04 17:40:29 +13:00
Jason Schwarzenberger 9fff1b9e46 avoid duplicate articles listed on the category page 2020-11-04 17:14:42 +13:00
Jason Schwarzenberger 16b59f6c67 try stop bad pages. 2020-11-04 16:34:31 +13:00
Jason Schwarzenberger 1318259d3d imply referrer is substack. 2020-11-04 15:21:07 +13:00
Jason Schwarzenberger d718d05a04 fix dates for newsroom. 2020-11-04 11:53:16 +13:00
Jason Schwarzenberger 9f4ff4acf0 remove unnecessary sitemap.xml request. 2020-11-04 11:22:15 +13:00
Jason Schwarzenberger 29f8a8b8cc add news site categories feed. 2020-11-04 11:08:50 +13:00
Jason abf8589e02 fix sitemap 2020-11-03 10:53:40 +00:00
Jason b759f46582 use extruct for opengraph/json-ld/microdata of articles 2020-11-03 10:31:36 +00:00
Jason Schwarzenberger 5f98a2e76a Merge remote-tracking branch 'tanner/master' into master
And adding relevant setings.py.example/etc.
2020-11-03 16:44:02 +13:00
Jason Schwarzenberger 76f1d57702 sitemap based feed. 2020-11-03 16:00:03 +13:00
Jason Schwarzenberger c5fe5d25a0 add substack.py top sites, replacing webworm.py 2020-11-03 12:28:39 +13:00
Jason 283a2b1545 fix webworm comments 2020-11-02 22:06:43 +00:00
Jason Schwarzenberger 0d6a86ace2 fix webworm dates. 2020-11-03 10:31:14 +13:00
Jason Schwarzenberger f23bf628e0 add webworm/substack as a feed. 2020-11-02 17:09:59 +13:00
tanner ca78a6d7a9 Move feed and Praw config to settings.py 2020-11-02 02:26:54 +00:00
tanner cbc802b7e9 Try Hackernews API twice 2020-11-02 00:17:22 +00:00
tanner feba8b7aa0 Make qotnews work with WaPo 2020-10-29 04:55:34 +00:00
tanner 6cf2f01b08 Adjust feeds 2020-10-03 23:41:57 +00:00
tanner 0e086b60b8 Remove business subreddit from feed 2020-08-14 03:55:28 +00:00
tanner 9a449bf3ca Remove extra logging 2020-07-08 02:36:40 +00:00
tanner 0bd9f05250 Fix crash when HN feed fails 2020-07-08 02:36:40 +00:00
tanner 850b30e353 Add requests timeouts and temporary logging 2020-07-08 02:36:40 +00:00
tanner f46cafdc90 Integrate sqlite database with server 2020-07-08 02:36:40 +00:00
tanner 8799b10525 Fall back to ref on manual submission title 2020-07-08 02:36:40 +00:00
tanner a4cf719cb8 Remove technology subreddit 2020-07-08 02:36:40 +00:00
tanner 595f469b4a Update tildes parser group tag 2020-07-08 02:36:40 +00:00
tanner b3d2eeb67f Fix tildes deleted comment parser error 2020-01-28 04:19:26 +00:00
tanner ebcbf1b624 Sanitize html 2019-12-01 22:18:41 +00:00
tanner 2edb3ceba7 Allow manual submission of articles 2019-11-08 05:55:30 +00:00
tanner bb693ba434 Add subreddit 2019-11-07 22:09:45 +00:00
tanner 9e55f6e4ec Fix Tildes down for maintenance edge case 2019-10-22 05:01:30 +00:00
tanner 810e8c5ead Archive WSJ articles first, catch KeyboardInterrupt 2019-10-15 21:03:47 +00:00
tanner 0f5b2a5ff9 Cache all articles in IndexedDB 2019-10-12 23:41:31 +00:00