12 Commits

Author	SHA1	Message	Date
Jason Schwarzenberger	b771b52501	add regex to get a unique ref from each sitemap/category based article url.	2020-11-17 12:38:28 +13:00
Jason Schwarzenberger	b23e470317	move reddit thresholds as settings variables.	2020-11-16 10:11:39 +13:00
Jason	00954c6cac	local browser scraper	2020-11-11 09:26:54 +00:00
Jason Schwarzenberger	3169af3002	hostname from settings.	2020-11-11 09:46:27 +13:00
Jason Schwarzenberger	7b8cbfc9b9	try to make feed only determined by the max age.	2020-11-09 17:50:58 +13:00
Jason Schwarzenberger	939f4775a7	better settings example.	2020-11-04 15:52:34 +13:00
Jason Schwarzenberger	9bfc6fc6fa	scraper settings, ordering and loop.	2020-11-04 15:47:12 +13:00
Jason Schwarzenberger	db6aad84ec	fix mistake.	2020-11-04 11:12:01 +13:00
Jason Schwarzenberger	29f8a8b8cc	add news site categories feed.	2020-11-04 11:08:50 +13:00
Jason Schwarzenberger	244d416f6e	settings config of sitemap/substack publications.	2020-11-03 17:01:29 +13:00
Jason Schwarzenberger	5f98a2e76a	Merge remote-tracking branch 'tanner/master' into master ... And adding relevant setings.py.example/etc.	2020-11-03 16:44:02 +13:00
Tanner Collin	ca78a6d7a9	Move feed and Praw config to settings.py	2020-11-02 02:26:54 +00:00