 Jason Schwarzenberger
|
da62f8859b
|
remove stupid idea.
|
2020-11-27 13:54:25 +13:00 |
|
|
Jason Schwarzenberger
|
fe4b02e8a1
|
add svelte app.
|
2020-11-27 13:43:47 +13:00 |
|
|
Jason Schwarzenberger
|
8bb2d174bf
|
info line adjustments.
|
2020-11-26 12:11:45 +13:00 |
|
|
Jason Schwarzenberger
|
72e2232469
|
fix substack comments.
|
2020-11-26 11:17:25 +13:00 |
|
|
Jason Schwarzenberger
|
247715a76e
|
adjust feed thread.
|
2020-11-25 12:34:46 +13:00 |
|
|
Jason Schwarzenberger
|
5c96092a57
|
sort ref_list so newly added is first.
|
2020-11-24 17:28:24 +13:00 |
|
|
Jason Schwarzenberger
|
2439c113b3
|
update declutter.
|
2020-11-24 16:54:21 +13:00 |
|
|
Jason Schwarzenberger
|
0f5e28136d
|
update declutter.
|
2020-11-24 11:20:37 +13:00 |
|
|
Jason Schwarzenberger
|
bb1413b586
|
sort substack feed by time.
|
2020-11-24 10:56:38 +13:00 |
|
|
Jason Schwarzenberger
|
0a27c0da1f
|
update declutter.
|
2020-11-24 10:42:41 +13:00 |
|
|
Jason Schwarzenberger
|
fe01ea52e5
|
get favicons for custom substack publications.
|
2020-11-24 10:36:31 +13:00 |
|
|
Jason Schwarzenberger
|
3daae5fa1b
|
change substack time parsing to misc.time
|
2020-11-23 16:46:54 +13:00 |
|
|
Jason Schwarzenberger
|
25caee17d6
|
add related stories to pre-fetch caching.
|
2020-11-23 16:26:37 +13:00 |
|
|
Jason Schwarzenberger
|
c1b6349771
|
namespace the refs for hn and substack.
|
2020-11-23 16:09:12 +13:00 |
|
|
Jason Schwarzenberger
|
a2e5faa3b5
|
fix empty source links.
|
2020-11-20 17:02:09 +13:00 |
|
|
Jason Schwarzenberger
|
a86eb98c1a
|
fix hn self posts related discussion.
|
2020-11-20 13:06:19 +13:00 |
|
|
Jason Schwarzenberger
|
abf7f0a802
|
force reader update in update-story.py
|
2020-11-20 12:21:27 +13:00 |
|
|
Jason Schwarzenberger
|
d288546d6f
|
update declutter.
|
2020-11-20 11:51:56 +13:00 |
|
|
Jason Schwarzenberger
|
cc130942ca
|
update declutter.
|
2020-11-20 11:48:46 +13:00 |
|
|
Jason Schwarzenberger
|
f0b14408d4
|
fix other discussions links.
|
2020-11-20 09:47:56 +13:00 |
|
|
Jason Schwarzenberger
|
e1830a589b
|
wip on other discussions ui.
|
2020-11-19 17:27:00 +13:00 |
|
|
Jason Schwarzenberger
|
32bc3b906b
|
add update-story.py
|
2020-11-19 15:06:55 +13:00 |
|
|
Jason Schwarzenberger
|
f5e65632b8
|
fix comment date.
|
2020-11-19 14:27:24 +13:00 |
|
|
Jason Schwarzenberger
|
1fe524207e
|
stuff comments.
|
2020-11-19 14:23:01 +13:00 |
|
|
Jason Schwarzenberger
|
dc3d17b171
|
update declutter
|
2020-11-19 12:30:27 +13:00 |
|
|
Jason Schwarzenberger
|
539350a83d
|
port separation.
|
2020-11-18 17:21:37 +13:00 |
|
|
Jason Schwarzenberger
|
2f730c1f52
|
update declutter.
|
2020-11-18 15:20:23 +13:00 |
|
|
Jason Schwarzenberger
|
e0960d59f3
|
update readme.
|
2020-11-18 13:26:34 +13:00 |
|
|
Jason Schwarzenberger
|
f5b38f5c6b
|
remove readerserver, add declutter.
|
2020-11-18 12:59:35 +13:00 |
|
|
Jason Schwarzenberger
|
c9da2a078b
|
increase setTimeouts.
|
2020-11-18 10:06:45 +13:00 |
|
|
Jason Schwarzenberger
|
78654e0c63
|
reduce setTimeout.
|
2020-11-17 16:07:33 +13:00 |
|
|
Jason Schwarzenberger
|
3b885e4327
|
renaming things.
|
2020-11-17 15:54:14 +13:00 |
|
|
Jason Schwarzenberger
|
55d50a86d8
|
hmmm
|
2020-11-17 15:13:38 +13:00 |
|
|
Jason Schwarzenberger
|
55e7f6bb14
|
cosmetic filters for newshub.
|
2020-11-17 15:01:12 +13:00 |
|
|
Jason Schwarzenberger
|
5668fa5dbc
|
fix mistake.
|
2020-11-17 12:54:54 +13:00 |
|
|
Jason Schwarzenberger
|
b771b52501
|
add regex to get a unique ref from each sitemap/category based article url.
|
2020-11-17 12:38:28 +13:00 |
|
|
Jason Schwarzenberger
|
f5c7a658ba
|
cosmetic filters for the spinoff.
|
2020-11-16 16:49:39 +13:00 |
|
|
Jason Schwarzenberger
|
f5ccd844da
|
fix import error.
|
2020-11-16 15:41:09 +13:00 |
|
|
Jason Schwarzenberger
|
6a91b9402f
|
split categories, sitemap and other crap out of news.py
|
2020-11-16 15:30:33 +13:00 |
|
|
Jason Schwarzenberger
|
b80c1a5cb5
|
extract story list item from Results and Feed.
|
2020-11-16 13:17:58 +13:00 |
|
|
Jason Schwarzenberger
|
b23e470317
|
move reddit thresholds as settings variables.
|
2020-11-16 10:11:39 +13:00 |
|
|
Jason Schwarzenberger
|
7420b5ece9
|
fix microdata multiple authors
|
2020-11-12 17:33:46 +13:00 |
|
|
Jason Schwarzenberger
|
64ced635cc
|
fix mistake.
|
2020-11-12 17:15:29 +13:00 |
|
|
Jason Schwarzenberger
|
9318627f1b
|
ability to pass in multiple site maps/category urls.
|
2020-11-12 17:11:51 +13:00 |
|
|
Jason Schwarzenberger
|
3d0a3f1577
|
support list based json-ld authors.
|
2020-11-12 15:08:23 +13:00 |
|
|
Jason Schwarzenberger
|
587b10c438
|
recursive sitemaps (sitemap indexes)
|
2020-11-12 14:56:46 +13:00 |
|
|
Jason Schwarzenberger
|
637bc38476
|
fix mistake.
|
2020-11-11 17:21:31 +13:00 |
|
|
Jason Schwarzenberger
|
164b7e72c4
|
basically add declutter like capabilities.
|
2020-11-11 17:16:04 +13:00 |
|
|
Jason Schwarzenberger
|
3169af3002
|
hostname from settings.
|
2020-11-11 09:46:27 +13:00 |
|
|
Jason Schwarzenberger
|
d588a60930
|
add source to searchable attributes.
|
2020-11-11 09:37:54 +13:00 |
|
|
Jason Schwarzenberger
|
408e2870b2
|
tzinfo and microdata schema urls.
|
2020-11-10 16:51:27 +13:00 |
|
|
Jason Schwarzenberger
|
44b8b36547
|
add data cast in query.
|
2020-11-10 15:50:18 +13:00 |
|
|
Jason Schwarzenberger
|
4f49684194
|
remove logos from utils.js
|
2020-11-10 15:38:48 +13:00 |
|
|
Jason Schwarzenberger
|
1d78b1c592
|
fix favicon url.
|
2020-11-10 15:34:21 +13:00 |
|
|
Jason Schwarzenberger
|
0374794536
|
Sitemap and Category to get favicon into icon property of story.
|
2020-11-10 15:22:27 +13:00 |
|
|
Jason Schwarzenberger
|
943a1cfa4f
|
reader server
|
2020-11-10 14:56:21 +13:00 |
|
|
Jason Schwarzenberger
|
9cee370a25
|
tvnz icon
|
2020-11-10 14:10:02 +13:00 |
|
|
Jason Schwarzenberger
|
5efc6ef2d3
|
add related stories (in api only)
|
2020-11-10 14:09:56 +13:00 |
|
|
Jason Schwarzenberger
|
4ec50e20cb
|
feed thread loop.
|
2020-11-10 10:10:38 +13:00 |
|
|
Jason Schwarzenberger
|
c1b7877f4b
|
remove limit.
|
2020-11-09 17:54:50 +13:00 |
|
|
Jason Schwarzenberger
|
7b8cbfc9b9
|
try to make feed only determined by the max age.
|
2020-11-09 17:50:58 +13:00 |
|
|
Jason Schwarzenberger
|
0bd0d40a31
|
use json type in sqlite.
|
2020-11-09 15:45:10 +13:00 |
|
|
Jason Schwarzenberger
|
4e04595415
|
fix search.
|
2020-11-09 15:44:44 +13:00 |
|
|
Jason Schwarzenberger
|
1f063f0dac
|
undo log level change
|
2020-11-06 11:20:34 +13:00 |
|
|
Jason Schwarzenberger
|
1658346aa9
|
fix news.py feed.
|
2020-11-06 10:37:43 +13:00 |
|
|
Jason Schwarzenberger
|
2dbc702b40
|
switch to python-dateutil for parser, reverse sort xml feeds.
|
2020-11-06 10:02:39 +13:00 |
|
|
Jason Schwarzenberger
|
1c4764e67d
|
sort sitemap feed by lastmod time.
|
2020-11-06 09:30:15 +13:00 |
|
|
Jason Schwarzenberger
|
095f0d549a
|
use replace.
|
2020-11-05 16:57:08 +13:00 |
|
|
Jason Schwarzenberger
|
c21c71667e
|
fix date issue.
|
2020-11-05 16:41:15 +13:00 |
|
|
Jason Schwarzenberger
|
c3a2c91a11
|
update requirements.txt
|
2020-11-05 16:33:50 +13:00 |
|
|
Jason Schwarzenberger
|
0f39446a61
|
tz aware for use in settings.
|
2020-11-05 16:30:55 +13:00 |
|
|
Jason Schwarzenberger
|
351059aab1
|
fix excludes.
|
2020-11-05 15:59:13 +13:00 |
|
|
Jason Schwarzenberger
|
4488e2c292
|
add an excludes list of substrings for urls in the settings for sitemap/category.
|
2020-11-05 15:51:59 +13:00 |
|
|
Jason Schwarzenberger
|
afda5b635c
|
disqus test.
|
2020-11-05 14:23:51 +13:00 |
|
|
Jason Schwarzenberger
|
0fc1a44d2b
|
fix issue in substack.
|
2020-11-04 17:40:29 +13:00 |
|
|
Jason Schwarzenberger
|
9fff1b9e46
|
avoid duplicate articles listed on the category page
|
2020-11-04 17:14:42 +13:00 |
|
|
Jason Schwarzenberger
|
16b59f6c67
|
try stop bad pages.
|
2020-11-04 16:34:31 +13:00 |
|
|
Jason Schwarzenberger
|
939f4775a7
|
better settings example.
|
2020-11-04 15:52:34 +13:00 |
|
|
Jason Schwarzenberger
|
9bfc6fc6fa
|
scraper settings, ordering and loop.
|
2020-11-04 15:47:12 +13:00 |
|
|
Jason Schwarzenberger
|
6ea9844d00
|
remove useless try blocks.
|
2020-11-04 15:37:19 +13:00 |
|
|
Jason Schwarzenberger
|
1318259d3d
|
imply referrer is substack.
|
2020-11-04 15:21:07 +13:00 |
|
|
Jason Schwarzenberger
|
98a0c2257c
|
increase declutter timeout.
|
2020-11-04 15:15:00 +13:00 |
|
|
Jason Schwarzenberger
|
e6976db25d
|
fix tabs
|
2020-11-04 15:04:20 +13:00 |
|
|
Jason Schwarzenberger
|
9edc8b7cca
|
move scraping for article content to files.
|
2020-11-04 15:00:58 +13:00 |
|
|
Jason Schwarzenberger
|
33e21e7f30
|
fix mistake.
|
2020-11-04 12:45:01 +13:00 |
|
|
Jason Schwarzenberger
|
892a99eca6
|
add + expander in place of collapser.
|
2020-11-04 12:43:15 +13:00 |
|
|
Jason Schwarzenberger
|
d718d05a04
|
fix dates for newsroom.
|
2020-11-04 11:53:16 +13:00 |
|
|
Jason Schwarzenberger
|
d1795eb1b8
|
add radionz and newsroom logos.
|
2020-11-04 11:30:56 +13:00 |
|
|
Jason Schwarzenberger
|
9f4ff4acf0
|
remove unnecessary sitemap.xml request.
|
2020-11-04 11:22:15 +13:00 |
|
|
Jason Schwarzenberger
|
db6aad84ec
|
fix mistake.
|
2020-11-04 11:12:01 +13:00 |
|
|
Jason Schwarzenberger
|
29f8a8b8cc
|
add news site categories feed.
|
2020-11-04 11:08:50 +13:00 |
|
|
Jason Schwarzenberger
|
736cdc8576
|
fix mistake.
|
2020-11-03 17:04:46 +13:00 |
|
|
Jason Schwarzenberger
|
244d416f6e
|
settings config of sitemap/substack publications.
|
2020-11-03 17:01:29 +13:00 |
|
|
Jason Schwarzenberger
|
5f98a2e76a
|
Merge remote-tracking branch 'tanner/master' into master
And adding relevant setings.py.example/etc.
|
2020-11-03 16:44:02 +13:00 |
|
|
Jason Schwarzenberger
|
0567cdfd9b
|
move sort to render.
|
2020-11-03 16:30:22 +13:00 |
|
|
Jason Schwarzenberger
|
4f90671cec
|
order feed by reverse chronological
|
2020-11-03 16:21:23 +13:00 |
|
|
Jason Schwarzenberger
|
e63a1456a5
|
add logos.
|
2020-11-03 16:07:07 +13:00 |
|
|
Jason Schwarzenberger
|
76f1d57702
|
sitemap based feed.
|
2020-11-03 16:00:03 +13:00 |
|
|
Jason Schwarzenberger
|
de80389ed0
|
add logos.
|
2020-11-03 12:48:19 +13:00 |
|
|
Jason Schwarzenberger
|
4e64cf682a
|
add the bulletin.
|
2020-11-03 12:41:16 +13:00 |
|