Commit Graph

42 Commits

Author SHA1 Message Date
074b898508 Fix lobsters comment parsing 2024-02-27 18:47:00 +00:00
494d89ac30 Disable lobsters 2023-09-13 01:02:15 +00:00
e79fca6ecc Replace "indent_level" with "depth" in lobsters API
See:
fe09e5aa31
2023-08-31 07:35:44 +00:00
c65fb69092 Handle Lobsters comment parsing TypeErrors
Too lazy to debug this:

2023-08-29 12:56:35,111 - root - INFO - Updating lobsters story: yktkwr, index: 55
Traceback (most recent call last):
  File "src/gevent/greenlet.py", line 854, in gevent._gevent_cgreenlet.Greenlet.run
  File "/home/tanner/qotnews/apiserver/server.py", line 194, in feed_thread
    valid = feed.update_story(story)
  File "/home/tanner/qotnews/apiserver/feed.py", line 74, in update_story
    res = lobsters.story(story['ref'])
  File "/home/tanner/qotnews/apiserver/feeds/lobsters.py", line 103, in story
    s['comments'] = iter_comments(r['comments'])
  File "/home/tanner/qotnews/apiserver/feeds/lobsters.py", line 76, in iter_comments
    parent_stack = parent_stack[:indent-1]
TypeError: unsupported operand type(s) for -: 'NoneType' and 'int'
2023-08-29T12:56:35Z <Greenlet at 0x7f92ad840ae0: feed_thread> failed with TypeError
2023-08-31 07:30:39 +00:00
632d028e4c Add Tildes group whitelist 2023-07-13 22:54:36 +00:00
ea8e9e5a23 Increase again 2023-06-13 17:11:50 +00:00
2838ea9b41 Increase Tildes story score requirement 2023-06-11 01:01:31 +00:00
f15d108971 Catch all possible Reddit API exceptions 2023-03-15 21:16:37 +00:00
a25457254f Improve logging, sends tweets to nitter.net 2022-03-05 23:48:46 +00:00
3f774a9e38 Improve logging 2021-09-06 00:21:05 +00:00
3ff917e806 Remove colons from date string so Python 3.5 can parse 2020-12-15 23:19:50 +00:00
c9fb9bd5df Add Lobsters to feed 2020-12-12 05:26:33 +00:00
ca78a6d7a9 Move feed and Praw config to settings.py 2020-11-02 02:26:54 +00:00
cbc802b7e9 Try Hackernews API twice 2020-11-02 00:17:22 +00:00
feba8b7aa0 Make qotnews work with WaPo 2020-10-29 04:55:34 +00:00
6cf2f01b08 Adjust feeds 2020-10-03 23:41:57 +00:00
0e086b60b8 Remove business subreddit from feed 2020-08-14 03:55:28 +00:00
9a449bf3ca Remove extra logging 2020-07-08 02:36:40 +00:00
0bd9f05250 Fix crash when HN feed fails 2020-07-08 02:36:40 +00:00
850b30e353 Add requests timeouts and temporary logging 2020-07-08 02:36:40 +00:00
f46cafdc90 Integrate sqlite database with server 2020-07-08 02:36:40 +00:00
8799b10525 Fall back to ref on manual submission title 2020-07-08 02:36:40 +00:00
a4cf719cb8 Remove technology subreddit 2020-07-08 02:36:40 +00:00
595f469b4a Update tildes parser group tag 2020-07-08 02:36:40 +00:00
b3d2eeb67f Fix tildes deleted comment parser error 2020-01-28 04:19:26 +00:00
ebcbf1b624 Sanitize html 2019-12-01 22:18:41 +00:00
2edb3ceba7 Allow manual submission of articles 2019-11-08 05:55:30 +00:00
bb693ba434 Add subreddit 2019-11-07 22:09:45 +00:00
9e55f6e4ec Fix Tildes down for maintenance edge case 2019-10-22 05:01:30 +00:00
810e8c5ead Archive WSJ articles first, catch KeyboardInterrupt 2019-10-15 21:03:47 +00:00
0f5b2a5ff9 Cache all articles in IndexedDB 2019-10-12 23:41:31 +00:00
5fd4fdb21c Fix Tildes comments with unknown authors 2019-10-08 08:01:17 +00:00
0496fbba45 Ignore new Tildes posts and handle deleted ones 2019-09-24 08:21:26 +00:00
0a1ebaa8b8 Handle Reddit PRAW exceptions 2019-09-24 08:20:46 +00:00
2ede5ed6ff Filter out False comments 2019-08-30 06:23:14 +00:00
23cdbc9292 Render reddit markdown, poll tildes better, add utils 2019-08-28 04:13:02 +00:00
cf9e197e6c Fix tildes comments parsing bug 2019-08-25 07:46:22 +00:00
1b6c8fc6cb Add tildes to feeds 2019-08-25 00:36:26 +00:00
a2509958da Add reddit to feeds 2019-08-24 21:37:43 +00:00
d341d4422f Abstract api server feeds 2019-08-24 08:49:11 +00:00
c1a81a4d8c Write news stories to disk 2019-08-24 05:07:16 +00:00
62d68da415 Finish prototype api server 2019-08-23 08:23:48 +00:00