72 Commits

Author	SHA1	Message	Date
Jason Schwarzenberger	1fe524207e	stuff comments.	2020-11-19 14:23:01 +13:00
Jason Schwarzenberger	b771b52501	add regex to get a unique ref from each sitemap/category based article url.	2020-11-17 12:38:28 +13:00
Jason Schwarzenberger	f5ccd844da	fix import error.	2020-11-16 15:41:09 +13:00
Jason Schwarzenberger	6a91b9402f	split categories, sitemap and other crap out of news.py	2020-11-16 15:30:33 +13:00
Jason Schwarzenberger	b23e470317	move reddit thresholds as settings variables.	2020-11-16 10:11:39 +13:00
Jason Schwarzenberger	7420b5ece9	fix microdata multiple authors	2020-11-12 17:33:46 +13:00
Jason Schwarzenberger	64ced635cc	fix mistake.	2020-11-12 17:15:29 +13:00
Jason Schwarzenberger	9318627f1b	ability to pass in multiple site maps/category urls.	2020-11-12 17:11:51 +13:00
Jason Schwarzenberger	3d0a3f1577	support list based json-ld authors.	2020-11-12 15:08:23 +13:00
Jason Schwarzenberger	587b10c438	recursive sitemaps (sitemap indexes)	2020-11-12 14:56:46 +13:00
Jason Schwarzenberger	3169af3002	hostname from settings.	2020-11-11 09:46:27 +13:00
Jason Schwarzenberger	408e2870b2	tzinfo and microdata schema urls.	2020-11-10 16:51:27 +13:00
Jason Schwarzenberger	1d78b1c592	fix favicon url.	2020-11-10 15:34:21 +13:00
Jason Schwarzenberger	0374794536	Sitemap and Category to get favicon into icon property of story.	2020-11-10 15:22:27 +13:00
Jason Schwarzenberger	5efc6ef2d3	add related stories (in api only)	2020-11-10 14:09:56 +13:00
Jason Schwarzenberger	1f063f0dac	undo log level change	2020-11-06 11:20:34 +13:00
Jason Schwarzenberger	1658346aa9	fix news.py feed.	2020-11-06 10:37:43 +13:00
Jason Schwarzenberger	2dbc702b40	switch to python-dateutil for parser, reverse sort xml feeds.	2020-11-06 10:02:39 +13:00
Jason Schwarzenberger	1c4764e67d	sort sitemap feed by lastmod time.	2020-11-06 09:30:15 +13:00
Jason	ee49d2021e	newsroom	2020-11-05 20:28:55 +00:00
Jason	c391c50ab1	use localize	2020-11-05 04:15:31 +00:00
Jason Schwarzenberger	095f0d549a	use replace.	2020-11-05 16:57:08 +13:00
Jason Schwarzenberger	c21c71667e	fix date issue.	2020-11-05 16:41:15 +13:00
Jason Schwarzenberger	0f39446a61	tz aware for use in settings.	2020-11-05 16:30:55 +13:00
Jason Schwarzenberger	351059aab1	fix excludes.	2020-11-05 15:59:13 +13:00
Jason Schwarzenberger	4488e2c292	add an excludes list of substrings for urls in the settings for sitemap/category.	2020-11-05 15:51:59 +13:00
Jason Schwarzenberger	afda5b635c	disqus test.	2020-11-05 14:23:51 +13:00
Jason Schwarzenberger	0fc1a44d2b	fix issue in substack.	2020-11-04 17:40:29 +13:00
Jason Schwarzenberger	9fff1b9e46	avoid duplicate articles listed on the category page	2020-11-04 17:14:42 +13:00
Jason Schwarzenberger	16b59f6c67	try stop bad pages.	2020-11-04 16:34:31 +13:00
Jason Schwarzenberger	1318259d3d	imply referrer is substack.	2020-11-04 15:21:07 +13:00
Jason Schwarzenberger	d718d05a04	fix dates for newsroom.	2020-11-04 11:53:16 +13:00
Jason Schwarzenberger	9f4ff4acf0	remove unnecessary sitemap.xml request.	2020-11-04 11:22:15 +13:00
Jason Schwarzenberger	29f8a8b8cc	add news site categories feed.	2020-11-04 11:08:50 +13:00
Jason	abf8589e02	fix sitemap	2020-11-03 10:53:40 +00:00
Jason	b759f46582	use extruct for opengraph/json-ld/microdata of articles	2020-11-03 10:31:36 +00:00
Jason Schwarzenberger	5f98a2e76a	Merge remote-tracking branch 'tanner/master' into master ... And adding relevant setings.py.example/etc.	2020-11-03 16:44:02 +13:00
Jason Schwarzenberger	76f1d57702	sitemap based feed.	2020-11-03 16:00:03 +13:00
Jason Schwarzenberger	c5fe5d25a0	add substack.py top sites, replacing webworm.py	2020-11-03 12:28:39 +13:00
Jason	283a2b1545	fix webworm comments	2020-11-02 22:06:43 +00:00
Jason Schwarzenberger	0d6a86ace2	fix webworm dates.	2020-11-03 10:31:14 +13:00
Jason Schwarzenberger	f23bf628e0	add webworm/substack as a feed.	2020-11-02 17:09:59 +13:00
Tanner Collin	ca78a6d7a9	Move feed and Praw config to settings.py	2020-11-02 02:26:54 +00:00
Tanner Collin	cbc802b7e9	Try Hackernews API twice	2020-11-02 00:17:22 +00:00
Tanner Collin	feba8b7aa0	Make qotnews work with WaPo	2020-10-29 04:55:34 +00:00
Tanner Collin	6cf2f01b08	Adjust feeds	2020-10-03 23:41:57 +00:00
Tanner Collin	0e086b60b8	Remove business subreddit from feed	2020-08-14 03:55:28 +00:00
Tanner Collin	9a449bf3ca	Remove extra logging	2020-07-08 02:36:40 +00:00
Tanner Collin	0bd9f05250	Fix crash when HN feed fails	2020-07-08 02:36:40 +00:00
Tanner Collin	850b30e353	Add requests timeouts and temporary logging	2020-07-08 02:36:40 +00:00