libera/#maemo/ Sunday, 2018-09-30

DocScrutinizer05folks. a coredump can be done with the process keeping running, right?07:33
KotCzarnyyes, with gdb07:41
KotCzarny(and probably other tools)07:42
DocScrutinizer05yeah, but obviously not with standard signal means07:50
DocScrutinizer05see man 2 signal and man 5 core07:50
DocScrutinizer05both say coredump implies process termination07:51
DocScrutinizer05well, to avoid falling for XY problem: infobot stops for a >2h each night at 00:20 UTC, and neither Tim (owner) nor I have any idea what's causing this. How would you try to tackle this shit?07:53
KotCzarnyit's not sigcore, but just a type of signals07:53
KotCzarnyie. sigquit is core too07:53
DocScrutinizer05I know07:54
KotCzarnyas for the bot, check cron?07:54
KotCzarnyor scripts the bot is using, might be some log managing07:54
KotCzarnyor db rehash07:54
DocScrutinizer05I suggested this to Tim a dozen times already. Even suspected logrotate the culprit. No reply by Tim07:55
KotCzarnydo you have access to the box?07:55
DocScrutinizer05I need a commandline I demand him doing07:55
DocScrutinizer05no07:55
KotCzarnysome monitoring then?07:55
DocScrutinizer05now we're talking. What exactly=07:56
DocScrutinizer05?07:56
KotCzarnydisk/network usage07:56
DocScrutinizer05meh07:56
KotCzarnyie. bot uploading something big07:56
DocScrutinizer05nothing too unusual07:56
KotCzarnyif it's a bot stoppping responding, it might be some script running and blocking everything else07:57
KotCzarnywhich would mean turning that script to run in parallel might help07:57
DocScrutinizer05to start with, I have no clear indication *why* the bot goes offline07:57
DocScrutinizer05I can remote-reboot the bot and already talked Tim into this reboot providing some diagnostic output. Alas I didn't find the one smart command to show what I need to know, about system status07:59
KotCzarnyit might be as simple as some script blocking the bot08:01
KotCzarnywhich obviously wouldnt show in most diagnostics08:01
DocScrutinizer05ps doesn't show anything suspicious08:01
KotCzarnyeasiest would be adding some debug log showing what funcs are starting and when08:02
KotCzarnyand popping that single print in most funcs08:02
DocScrutinizer05would seem like the bot goes OOM08:11
KotCzarnywhich would sound as some script trying to run big data08:12
DocScrutinizer05well yeah. I could speculate all day long. I have no clue what to talk Tim into, to *fix* the issue08:14
DocScrutinizer05~seen rimriker08:15
infobotDocScrutinizer05: i haven't seen 'rimriker'08:15
DocScrutinizer05~seen timriker08:15
infobottimriker <~TimRiker@bzflag/projectlead/TimRiker> was last seen on IRC in channel #infobot, 25d 10h 35m 30s ago, saying: 'added a netstat -ntp|grep perl'.08:15
KotCzarnyclearly he has no time to fix it, and no one else has the access, which basically boils down to nothing is going to be done08:15
DocScrutinizer05that's a pretty useless revelation08:16
KotCzarnybut clearly directs to the deeper issue08:16
DocScrutinizer05so???08:16
KotCzarnyyou can speculate all day long, without results08:16
DocScrutinizer05so???08:16
DocScrutinizer05do you want to tell me you're short of ideas how to tackle this? Noted08:17
DocScrutinizer05I'm too, right now08:18
KotCzarnyi've already shared few ideas, but without access they are unusable08:18
DocScrutinizer05I have 'access', just not the type of access you might think of when you hear the term08:19
DocScrutinizer05>>saying: 'added a netstat -ntp|grep perl'<< is what results from my type of "access", I demanded for a netstat to rule out uplink clogging08:20
KotCzarnynah, it more sounds as some homecleaning script running in the bot08:21
DocScrutinizer05and I can trigger this and all the other diagnostic rools by doing a bot reboot08:21
KotCzarnywhich takes a while, doesnt hit big cpu/network, but still blocks further execution08:21
DocScrutinizer05tools*08:21
DocScrutinizer05please check this https://pastebin.com/k2eACYn6 it has some errors that might well be worth a closer look and inverstigation. alas the bot is perl and thus I'm totally lost. /join #infobot  for sourcecode etc08:27
DocScrutinizer05I gonna provide a reboot log based on operational state now08:38
DocScrutinizer05~+status08:38
infobotSince Sun Sep 30 02:25:36 2018, there have been 0 modifications, 0 questions, 0 dunnos, 0 morons and 0 commands.  I have been awake for 4h 13m 4s this session, and currently reference 119769 factoids.  I'm using about 80728 kB of memory. With 0 active forks. Process time user/system 12.89/0.57 child 0/008:38
DocScrutinizer05~wb08:41
DocScrutinizer05oops08:41
DocScrutinizer05https://pastebin.com/cssbAu0W08:41
DocScrutinizer05gosh, does that PoS critter hang on reboot now?08:43
KotCzarnychat.freenode.net should be irc.freenode.com ?08:46
KotCzarnycheck shell ulimits08:48
KotCzarnyulimit -a08:48
DocScrutinizer05well, when I want to tell Tim "please add a diagnostics line to check ulinit -a", I need a rationale WHY I think this is a relevant info, what we expect it to be, and what we hope to fix by messing with it08:50
KotCzarnyOut of memory!08:51
KotCzarnythis maybe08:51
KotCzarnywould be interesting to find that string exact in scripts08:51
DocScrutinizer05you seen the timestamps of those loglines in ibot's log?08:51
KotCzarnycould it could pinpoint the place where it does that big job08:52
KotCzarny(although it might be generic perl err msg)08:52
KotCzarnytimestamps or not, it probably has more than one problem08:53
DocScrutinizer05it is08:53
DocScrutinizer05fsckng bot hangs on reboot!!! >:-(08:55
KotCzarnyperlmonks link to debug things: https://www.perlmonks.org/?node_id=59868508:55
KotCzarnyalso suggests checking ulimit08:55
DocScrutinizer05which actually migh be a GOOD thing, catching it while it does whatever it does when it takes 2h+ to re-login08:56
DocScrutinizer05ooh, no, that been me now, should stop messing with bot when tired08:56
KotCzarnymaybe it has some task to do which it tries to do for months but dies by killing08:57
DocScrutinizer05[2018-09-30 08:44:58] --> infobot (ibot@208.53.50.136) has joined this channel.08:57
DocScrutinizer05[2018-09-30 08:44:58] *** ChanServ sets mode: +v infobot08:57
DocScrutinizer05~wb08:58
infobotIt's great to be back!08:58
DocScrutinizer05~+status08:58
infobotSince Sun Sep 30 06:56:10 2018, there have been 0 modifications, 1 question, 0 dunnos, 0 morons and 0 commands.  I have been awake for 2m 11s this session, and currently reference 119769 factoids.  I'm using about 80264 kB of memory. With 0 active forks. Process time user/system 1.29/0.12 child 0/008:58
DocScrutinizer05~+uptime08:58
infobot- Uptime for apt -08:58
infobotNow: 2m 24s running infobot 1.5.4 (SVN) -- linux08:58
infobot1: 59d 8h 41m 19s running infobot 1.5.4 (SVN) -- linux, ended Sun Nov 14 18:39:57 201008:58
infobot2: 57d 3h 9m 23s running infobot 1.5.4 (SVN) -- linux, ended Fri Jun 26 20:39:27 200908:58
infobot3: 53d 8h 24m 4s running infobot 1.5.4 (SVN) -- linux, ended Tue Nov  7 05:34:20 201708:58
KotCzarnyrandom crap to debug memory in perl: http://perldoc.perl.org/perldebguts.html#Debugging-Perl-memory-usage09:00
KotCzarnymight actually be useful if you get a coredump and want to step through it09:01
KotCzarnyhttp://perldoc.perl.org/perldebguts.html#Debugging-Perl-Memory-Usage (proper link)09:02
DocScrutinizer05http://laforge.gnumonks.org/blog/20180929-fernvale-discount/09:02
KotCzarny2g is being killed of around the world09:03
KotCzarnymight be the reason of lack of interest09:03
KotCzarny*off09:04
DocScrutinizer05yep, sure09:23
DocScrutinizer05yet there are amazing things going on, like Michaela Spacefalconia trying to re-release a  (Openmoko Freerunner) TI Calypso chipset based 2G modem module09:25
DocScrutinizer05I for one think ^^^ this stuff is more rewarding than Calypso09:27
sicelostupid question - but i must ask nonethelese - the telco in my country uses overhead lines, and our area is also prone to lightning strikes in summer. what is the best way (besides disconnecting, of course) to protect the adsl modem/router from this?21:31
KotCzarnynothing protects you from direct (or even in neighbourhood) lightning hit21:33
KotCzarnymy friend had such incident few years ago21:33
KotCzarnylightning hit the house 2-3 buildings away21:33
KotCzarnyhis modem way flying across the room leaving sparks and burns trail21:34
KotCzarnys/way/was21:35
sicelogosh21:37
siceloat least no one's reported such here21:38
KotCzarnyi have heard few stories about ethernet networks hung around the neighbourhoods too, those tend to burn routers/switches first21:38
KotCzarnyso just dont worry and keep your data safe21:39
KotCzarnyie. store backups in different locations21:39
sicelowell our modems dead now. no idea when isp will provide replacement.21:44
KotCzarnythere are some telephone line isolators, but as i've said, nothing protects from close hit21:45
KotCzarnysome power strips provide filtering for modem lines21:45
siceloisp doesn't like those. :)21:46
KotCzarnythey just have to pass high freqs, while still protecting from voltage spikes21:46
sicelothey complained that it causes the signal to be 'sent back' to their more expensive equipment :D21:46
KotCzarnyrrrright21:46
siceloi never got time to study how they really work to see if their claim was correct (i doubt)21:47
KotCzarnythat might be true for some cheapo ones21:50
siceloguess we must be sure to disconnect then, assuming storm happens when we're around22:04

Generated by irclog2html.py 2.17.0 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!