#editorial | Logs for 2020-04-22

« return
[00:15:05] -!- AzumaHazuki [AzumaHazuki!~hazuki@the.end.of.time] has joined #editorial
[01:39:04] -!- systemd has quit [Remote host closed the connection]
[01:39:10] -!- systemd [systemd!~systemd@pid1] has joined #editorial
[02:45:54] -!- systemd has quit [Remote host closed the connection]
[02:46:05] -!- systemd [systemd!~systemd@pid1] has joined #editorial
[05:15:34] -!- AzumaHazuki has quit [Remote host closed the connection]
[06:50:27] -!- systemd has quit [Remote host closed the connection]
[06:53:20] -!- systemd [systemd!~systemd@pid1] has joined #editorial
[06:58:33] <chromas> janrinok: how goes it?
[07:35:45] <janrinok> it goes OK thanks - sry for the delay, I was helping the nurse. kyonko speaks in riddles - I decided to leave the channel
[07:38:14] <chromas> Seems pretty bot-like
[07:38:46] * chromas wonders if there's an sn xmpp server
[07:40:01] <chromas> Doesn't seem to be mentioned anywhere so probably no
[07:42:13] <janrinok> I've not heard of one
[07:42:22] <janrinok> ... but that means nothing!
[07:43:36] <chromas> I'm thinking there isn't one
[07:43:49] <chromas> I just wanted to do some tests 'cause mine's a butt
[07:44:15] <chromas> Can't send files, although that's nothing new to xmpp
[07:45:37] * chromas breaks everything
[07:46:19] <janrinok> do you want me to install something (jabber) to see if we can get it to work?
[07:49:01] <chromas> Probably more work than it's worth
[07:50:14] <janrinok> OK, but if you change your mind it isn't a big issue at this end
[07:50:44] <chromas> Well you can if you're itchin' for something different
[07:50:56] <chromas> btw, can storybot use proxies?
[07:51:34] <janrinok> it uses the system proxy - there is no code to manage proxies as it stands at the moment
[07:51:38] <chromas> Earlier I was thinking about having a page to put all the scraper's output side-by-side so I thought it'd be good to use a proxy to minimize the server hits
[07:51:43] <chromas> ah
[07:52:42] <janrinok> I only download once per hour as it stands at the moment, although it can be started as often as the user wishes
[07:54:10] <chromas> I'm thinking of my scraper page. It could have a field to paste in a url and it could use all the scrapers and show all their output at once
[07:54:17] <chromas> Probably not useful but it was a thought
[07:55:11] <janrinok> understood - and storybot can already do that, depending on which version you have.
[07:59:26] <chromas> It's good to see takyon's still checking in on us, even if he doesn't irc no mo'
[08:00:25] <chromas> Looks like I've got storybot5
[08:00:42] <janrinok> there are plenty of public xmpp servers, and I suppose we could set a jabber server up on one of our (SN) servers.
[08:01:10] <janrinok> option -u URL should analyse any story
[08:01:21] <chromas> That's what I'm using
[08:01:52] <chromas> I was just wondering about proxies so I could hit the same url over and over with various scrapers without dinging servers
[08:01:59] <janrinok> ah OK. How often do you run your rss feeds
[08:02:23] <janrinok> or are you monitoring them in real time?
[08:02:30] <chromas> could also curl a url and hit a local version but that would screw up url rewrites and stuff
[08:02:44] <chromas> I'm not running the feed part
[08:03:15] <chromas> Maybe I should though. The feed reader I'm using kinda sucks
[08:03:16] <janrinok> fairy 'nuff
[08:04:26] <janrinok> the version you have only scans the SN feed as the feedreader is currently disabled. I'm re-writing the feedparser at present
[08:05:21] <chromas> that's what I need to do
[08:05:24] <chromas> but in D
[08:05:26] <chromas> :)
[08:06:02] <chromas> I need to add support for JSON Feed too https://jsonfeed.org
[08:06:02] <systemd> ^ 03JSON Feed: Home
[08:06:04] <exec> └─ 13JSON Feed: Home
[08:06:11] <janrinok> I've discovered that some feeds do not follow the RSS 2.0 or ATOM specs exactly as they should - but no surprise there
[08:06:18] <chromas> for all both of the sites using it
[08:07:16] <chromas> How many of those nonconforming sites are using feedburner?
[08:07:35] <janrinok> no eyed deer#
[08:07:36] <chromas> my storybot's 20191005-15:39
[08:07:55] * chromas has no stats on how much it gets used though
[08:08:15] <janrinok> give me a day or two to finish and merge the branch that I am working on and I will update it for you
[08:08:57] <janrinok> is feedburner known for be non-compliant?
[08:09:04] <chromas> I need to learn branching and stuff. I just do git commit once in a while and call it good
[08:09:57] <chromas> I dunno, but it's a google thing
[08:10:33] <chromas> so the story urls tend to have redirection through google tracking servers
[08:10:45] <janrinok> that probably means it is non-compliant! Google wants to do a Microsoft so that people are tied-in to their version, I guess
[08:12:51] <janrinok> are you using jsonfeed yourself?
[08:13:27] <chromas> It's supposed to give sites insights into people reading their feeds and clicking through to stories but from what I've read a lot of people don't like it, the support is barely there and it's almost like it's abandoned but still running
[08:13:29] <chromas> no
[08:13:50] <chromas> but it's there
[08:15:41] <janrinok> I've not seen many news sites using that icon which suggests that not very many are currently providing data in that format. I'm wondering whether the effort is justified as I have other capabilities that I judge will be more useful
[08:17:52] <chromas> Seems like sites are just abandoning any sort of feed
[08:18:03] <chromas> Might eventually have to just build a page scraper
[08:18:09] <chromas> or an automatic one
[08:24:50] <chromas> Apparently there's a thing called lolfeed
[08:24:55] <chromas> https://api.flickr.com
[08:27:02] <janrinok> perhaps it is just those sites that want everyone to have to log in (for data scraping) or pay for access to their news reports
[08:28:15] <chromas> My local news site uses javascript to paywall pages after they're already loaded
[08:28:44] <janrinok> that should be easily defeated then... but don't tell them!
[08:30:25] <chromas> ah oh. I don't see 'em in my rss feed anymore. Hope they didn't change it
[08:32:31] <chromas> 12 feeds returning 0 items and one telling me it's not even a real feed
[08:33:32] <janrinok> that doesn't sound right!
[08:34:25] <janrinok> I've got 55 new stories from the SN feeder and the US day hasn't even started yet
[08:35:13] <chromas> They've been doing it for awhile. I have the feeds update at different intervals but since they fail they all collect to run at the same time every update
[08:35:22] <chromas> Looks like I haven't got local paper since 2018
[08:35:29] <chromas> I don't read local new very often
[08:35:51] <janrinok> perhaps they found that everybody else could defeat their paywall too
[08:37:34] <chromas> This is weird. The rss link still works and returns current news
[08:39:05] <chromas> and the db says it was updated on the 22th
[08:39:56] <chromas> oh disregard that I'm retarded
[08:40:01] <chromas> Helps to sort the table
[08:46:33] <janrinok> lol
[08:46:46] * chromas counts his rows
[08:47:42] <chromas> Taking so long the progress bar gave up and disappeared
[08:48:07] <chromas> oh. 2,584,639 news items
[08:48:13] <chromas> At least three are duplicates though
[08:48:37] <janrinok> how long do you keep them for? I purge all my old stories.
[08:48:50] <chromas> Forever. They all go into a database
[08:49:00] <chromas> I need to figure out how to make search better though
[08:50:32] <chromas> local paper only puts one-liners in their rss feed
[08:50:50] <janrinok> that sounds like quite a lot of links - do you know how many of them are still valid, or do you assume that they all are?
[08:50:51] <chromas> but they don't know I have a nice little button to load the articles right into the feed
[08:51:12] <chromas> Haven't checked
[08:52:29] <chromas> The idea was to have something faster than using google or bing news and also be able to search history a bit for reference
[09:07:17] <janrinok> good idea
[09:07:47] <chromas> Search can be super slow though, especially for short, single-word searches
[09:08:04] <chromas> Most likely will gateway timeout before the search is done
[09:11:03] <janrinok> so you store the entire text in your db?
[09:11:27] <chromas> I do
[09:11:33] <chromas> Only what's in the rss feed
[09:11:51] <chromas> well, the entirety of certain fields. there's probably more stuff I don't catch
[09:12:25] <janrinok> I store the complete submission, but I only keep them for a couple of months at most
[09:13:04] <janrinok> I have never found a need to go and search them so I'm not sure why I keep them - but I do, for the time being at least
[09:16:14] <chromas> I don't need it either but it was fun to build it half-way then go off to start another project :D
[09:16:38] <chromas> Also started a rewrite in D but the search part doesn't work
[09:17:41] <chromas> Did you ever find any sort of niche use for D?
[09:17:51] <chromas> Assuming you even had time to play with it
[09:20:43] <janrinok> the latter I'm afraid - I find that with the limited time that I have just keeping on top of the other projects that I have is keeping me busy. It is on my list of things that I _want_ to do, but that list is behind the list of things that I _have_ to do!
[09:43:14] -!- cosurgi has quit [Ping timeout: 244 seconds]
[09:49:08] -!- cosurgi [cosurgi!~cosurgi@pskvpf01.bl.pg.gda.pl] has joined #editorial
[09:50:08] cosurgi is now known as SoyGuest93038
[11:55:23] SoyGuest93038 is now known as cosurgi
[11:55:27] -!- cosurgi has quit [Changing host]
[11:55:27] -!- cosurgi [cosurgi!~cosurgi@Soylent/Staff/Misc/cosurgi] has joined #editorial
[13:13:42] <Bytram> Hi everyone
[13:13:54] <Bytram> Popping in for a bit to catch up on things
[13:14:12] <Bytram> I noticed one of my stories was set to NOT display.
[13:14:21] <Bytram> (1) Good catch! Thanks!
[13:16:18] <Bytram> (2) When that happens, though, it leaves a gap in the story queue, so it's usually a good idea to move a later story forward, to fill its gap... I have found it best to schedule it 1 minute afterwards, so it is clear from context what has happened...
[13:17:40] <Bytram> and being *newer*, my script -- which calculates a new story release date/time after the latest-scheduled story -- doesn't get thrown off.
[13:18:06] <Bytram> I'm expecting a phone call shortly, but will see if I can quickly push out a story or two.
[13:21:26] <Bytram> =g oann
[13:21:27] <systemd> https://www.oann.com - One America News Network | Your Nation. Your News.
[13:22:36] <Bytram> In my defense, I think I may have processed that sub with my phone.
[13:29:52] <Bytram> Or, more likely, failed to remember oann and its 'history'.
[13:30:47] <Bytram> apparently, I can't remember *everything*. Thanks for again for the good catch!
[13:35:47] -!- AzumaHazuki [AzumaHazuki!~hazuki@the.end.of.time] has joined #editorial
[14:07:05] -!- AzumaHazuki has quit [Remote host closed the connection]
[14:55:28] <Bytram> https://www.spacex.com
[14:55:28] <systemd> ^ 03STARLINK MISSION
[15:01:18] <Bytram> janrinok: Ping!
[15:01:27] <janrinok> pong
[15:01:38] <Bytram> I just submitted a time-sensitive story about spacex launching a mission today
[15:02:01] <Bytram> beware, I've seen different scheduled times depending on where I looked.
[15:02:24] <janrinok> ok, and?
[15:02:43] <janrinok> where do you want me to put it? (in the nicest possible way ;) )
[15:02:44] <Bytram> lookslike lauch is scheduled for 4.5 hours from now. would be nice if we could get the story out soonish.
[15:02:52] <Bytram> LOL!lemme check
[15:03:45] <Bytram> 19:16 would be toolate...
[15:03:54] <Bytram> in the 17:03 slot?
[15:04:00] <janrinok> oooh, I'll have to ask the AEinC - he is in charge as I recall.....
[15:04:19] <Bytram> or his deputy?
[15:04:30] <Bytram> now who could *that* be?
[15:04:31] <janrinok> OK, I'll let it go this once....
[15:04:49] <Bytram> so very kind of you sir!
[15:05:09] <Bytram> It was a quick submit, so do please double check the links for me?
[15:05:20] <janrinok> as I normally would, of course
[15:05:36] <Bytram> awed awed
[15:05:41] <Bytram> =)
[15:05:46] <Bytram> mare see
[15:05:51] <janrinok> how you feeling?
[15:06:01] <Bytram> as opposed to a no eyed ear.
[15:06:16] <janrinok> no eye deer
[15:07:12] <Bytram> better. Still dragging. If I keep feeling better after another good night's sleep... tells me how far down the scale I dragged myself. Cold and windy today, so not going out for a walk
[15:07:46] <Bytram> methinks there may be a bit of coming out of SADD, to it, too.
[15:08:25] <Bytram> I'm seriously considering making breakfast and going back to bed.
[15:09:02] <janrinok> it sounds very much like I was feeling about a month ago, just after my scheduled break was cancelled because of CV. I've had to completely replan our day just to make sure I don't make myself useless
[15:09:26] <Bytram> yes, I've been thinking of that, often. I feel guilty.
[15:09:36] <janrinok> go back to bed. Story posted - the original has been moved to tomorrow
[15:09:58] <Bytram> 2nding it (and your other stories) now
[15:10:12] <janrinok> well don't feel guilty - keep yourself fit and well by resting and not over exerting yourself
[15:11:54] <Bytram> goose ganders a look at the gander
[15:12:26] <Bytram> I saw CoolHand popped in a couple stories the other day =)
[15:12:43] <janrinok> lol - I've tried to ease back half a dozen times since Christmas - but the rest of the team keep dropping like flies....!
[15:12:56] <Bytram> I'd rather we go to fewer stories a day than to have you repeat a prior 'performance' !!!
[15:13:31] <janrinok> yes, it was good to see that he is still around. I've lost track of what everybody is doing. I suppose some are essential workers and some others are just surviving
[15:14:42] <janrinok> as long as Fnord666 can keep posting as he is doing, then the rest of us can fill the gaps. Otherwise I would suggest going to 10 a day 7 days a week - but we are not there yet
[15:15:03] <Bytram> good to plan ahead, just in case.
[15:15:25] <Bytram> w2? https://www.weibo.com
[15:15:29] <systemd> ^ 03Sina Visitor System ( https://passport.weibo.com )
[15:15:33] <exec> └─ 13Sina Visitor System
[15:15:37] <janrinok> just a suggestion - I suppose others might have different rates but I'll bet they are all fairly similar
[15:16:11] <janrinok> That weibo link gets there eventually but is s l o w
[15:16:31] <Bytram> k
[15:16:54] <Bytram> I very strongly dislike tracking links
[15:16:59] <janrinok> Some might be able to get that site but it isn't critical to the story, just background info
[15:17:29] <Bytram> I'll happily replace a tracking link in a story with its destination, as a service to our communitu
[15:17:35] <janrinok> ... and it's also in Chinese and requires a log in - but we might have a reader in HK who can give us some feedback.
[15:17:46] <Bytram> yep
[15:18:01] <janrinok> gtg - dinner prep time!
[15:18:14] <janrinok> go to bed and rest!
[15:18:16] <Bytram> k
[15:18:20] <janrinok> laters
[15:18:23] <Bytram> and *now* I see your editor's note
[15:18:34] * Bytram will move it ahead of blockquote
[15:18:40] <janrinok> as you wish
[15:19:31] <Bytram> it'slike reading a 10 paragraph comment,and *then* seeing the tl;dr
[15:20:04] <Bytram> =g "As you wish"
[15:20:06] <systemd> https://www.asyouwishpottery.com - AS YOU WISH - Pottery Painting Place
[15:20:10] <Bytram> #yt "As you wish"
[15:20:10] <MrPlow> https://www.youtube.com -- [MV] 우주소녀 (WJSN) - 이루리 (As You Wish)
[15:20:17] <Bytram> #yt "As you wish" princess bride
[15:20:17] <MrPlow> https://www.youtube.com -- The Princess Bride (6/12) Movie CLIP - As You Wish (1987) HD
[15:20:23] <Bytram> =)
[16:24:29] <Bytram> =submit https://hackaday.com
[16:24:30] <systemd> Submitting "A Jaw-Dropping Demo In Only 256 Bytes"...
[16:24:31] <exec> └─ 13A Jaw-Dropping Demo In Only 256 Bytes | Hackaday
[16:24:52] <systemd> ✓ Sub-ccess! "03a Jaw-Dropping Demo in Only 256 Bytes" (8 paragraphs) -> https://soylentnews.org
[20:31:40] <Bytram> w? https://arstechnica.com
[20:31:42] <systemd> ^ 03A critical iPhone and iPad bug that lurked for 8 years is under active attack ( https://arstechnica.com )
[20:31:42] <exec> └─ 13A critical iPhone and iPad bug that lurked for 8 years is under active attack | Ars Technica
[20:31:58] <Bytram> ~=submit https://arstechnica.com
[20:32:00] <exec> └─ 13A critical iPhone and iPad bug that lurked for 8 years is under active attack | Ars Technica
[20:32:33] <Bytram> =g doi:10.1126/science.abc4056
[20:32:34] <systemd> https://www.ncbi.nlm.nih.gov - PSYCHOLOGY. Estimating the reproducibility of psychological ...
[20:32:47] <Bytram> =cite https://onlinelibrary.wiley.com
[20:32:48] <systemd> Journal Reference O. Unsalan, A. Bayatlı, P. Jenniskens. Earliest evidence of a death and injury by a meteorite, <cite>Meteoritics & Planetary Science</cite> (DOI: <a href="https://doi.org/10.1111/maps.13469">10.1111/maps.13469</a>)
[20:32:50] <exec> └─ 13Earliest evidence of a death and injury by a meteorite - Unsalan - - Meteoritics & Planetary Science - Wiley Online Library
[20:32:53] <Bytram> https://www.sciencemag.org
[20:32:54] <systemd> ^ 03Archivists uncover earliest evidence of a person being killed by a meteorite
[20:33:50] <Bytram> =g sciencedaily.com "doi:10.1126/science.abc4056"
[20:33:51] <systemd> [0 results]
[20:33:58] <Bytram> =g sciencedaily.com "10.1126/science.abc4056"
[20:33:59] <systemd> [0 results]
[20:34:05] <Bytram> =g sciencedaily "10.1126/science.abc4056"
[20:34:06] <systemd> [0 results]
[20:41:37] <chromas> Your submit didn't go
[20:41:47] <chromas> Also, there's =sub for less typing
[20:43:27] <Bytram> =sub https://arstechnica.com
[20:43:28] <exec> └─ 13A critical iPhone and iPad bug that lurked for 8 years may be under active attack | Ars Technica
[20:43:28] <systemd> Submitting "A critical iPhone and iPad bug that lurked for 8 years may be under active attack"...
[20:43:40] <Bytram> obliged
[20:43:50] <systemd> ✓ Sub-ccess! "03a Critical iPhone and iPad Bug That Lurked for 8 Years May be Under Active Attack" (12 paragraphs) -> https://soylentnews.org
[21:10:26] <Bytram> https://arstechnica.com
[21:10:27] <systemd> ^ 03The Falcon 9 just became America’s workhorse rocket ( https://arstechnica.com )
[21:10:28] <exec> └─ 13The Falcon 9 just became America’s workhorse rocket | Ars Technica
[21:20:24] <Bytram> https://blogs.sciencemag.org
[21:20:25] <systemd> ^ 03The Politics of Hydroxychloroquine
[21:20:59] <Bytram> someone is very not happy
[21:21:08] <Bytram> laters