libera/#devuan/ Tuesday, 2018-12-11

minnesotags1Hello, We have a 5 node Proxmox setup connecting to a 6 node Ceph of approximately 60T usable space (3x duplication). We have approximately 90 hosted VMs most of them Windows 2012 server. We are looking for a new virtualization platform. I've worked with OpenStack, but find it very tough to administer/maintain. We are mostly in house. Is Opennebula the thing for us?00:08
minnesotags1Also, How is the support for Opennebula on Devuan?00:09
golinuxminnesotags: Haven't see you in a while . . .00:09
golinuxseen00:09
minnesotags1Yup.....00:12
minnesotags1I recently started a new job! ;-)00:13
Weeazyhello02:51
golinuxWeeazy: Do you have a question?02:55
golinuxJust ask02:55
Weeazyno no, no question. I installed devuan a while back. It's been running great. I was just looking in to see what might be happening, with new releases and such02:57
golinuxYou're running ascii?02:59
WeeazyI installed in 2016 I think. Never ascii.03:00
Weeazymaybe when it was in beta?03:00
golinuxWell, ascii is the current stable release03:00
Leanderminnesotags1: we played with open nebula almost two years ago, the main problem was the lack of packages so we made custom ones by patching the debian ones, to basically remove one systemd command in the post-inst script03:01
WeeazyI was chatting with a person here that was working trying to get cinnamon to work on devuan, I wonder if that ever came about?03:01
gnarfacei think they succeeded at that but i forget who that was03:02
gnarfacesomeone got mate working too03:02
golinuxWeeazy: Yes. It is an option in ascii.03:02
Weeazyok, that's great! I'll have to look and see when I can schedule the upgrade. That machine is in service full time atm03:03
golinuxhttps://files.devuan.org/devuan_ascii/Release_notes.txt03:04
golinuxBe sure to read to avoid gottchas03:04
Weeazyok. sure will.03:04
golinuxYou too gnarface.  ;)03:04
Weeazyyou know, I was using a primary machine with windows on it. And they just keep upgrading and upgrading and I can't turn it off. What's more, I think they are just making a big spy machine03:05
golinuxYou are probably right03:06
golinuxNo spying here.03:06
Weeazyso now both of my machines are linux03:06
golinuxGreat!03:06
WeeazyI'm very happy with linux and especially devuan. I feel more secure with devuan03:06
golinuxDevuan is pretty much by geeks for geeks03:07
golinuxDefinitely not for the clueless.03:07
WeeazyI see there is an upgrade option from debian Jessie. that's awesome. I have one installation of that.03:09
golinuxYes, there are instructions on the website.03:10
salsburyhey03:20
salsburyhave you guys noticed a performance drop in kernel 4.19?03:21
gnarfacei think one is expected, no?03:21
salsburybecause of meltdown?03:22
gnarfaceyea, because of the spectre/meltdown patches03:22
gnarfacei can't tell you if 4.20 is better or worse03:22
salsburyso... 4.9 isn't implementing them even on recent releases?03:22
gnarfacehmmm. i don't actually know if they backported those patches to 4.9 or not03:23
gnarfaceit is the type of thing debian would do, and the kernel devuan is using is just the stock debian kernel03:23
salsburyme neither, I assumed they would...but never checked03:23
salsburyhmmm03:24
salsburyoh well, maybe I've done something wrong03:24
gnarfacehow much performance loss are you talking about here?03:24
salsburyI'm measuring it in degrees CÂș, nothing serious. havend done any benchmarks other than just eye balling03:25
debdogmayhap there's a mouse stuck in the heatsink?03:26
salsburyheheh03:26
salsburynot likely03:26
salsburyI've noticed it gets slower in single thread tasks though03:27
gnarfacethere's all kinds of other things that might have changed like default cpu frequency governor or video card driver03:27
debdogwhat I was trying to says, it could be a coincidence03:27
salsburyand a pronounced delay at boot time, while setting up a ramdisk, right after grub03:27
gnarfacehmmm03:27
salsburygnarface, actually, the governor is the same03:27
salsburyI took care of that03:28
targzHi all, any news about adding the site https://www.gnutransfer.com/en in https://devuan.org/os/install what ?03:29
salsburybut don't sweat it guys, other than the ramdisk thing, it's just a feel, nothing critical03:29
targzsorry: any news about adding the site https://www.gnutransfer.com/en in https://devuan.org/os/install?03:30
salsburyI just wanted to know if you knew about a common well known bug or something03:30
gnarfacesalsbury: looks like the patches have been mostly applied, depending on architecture: https://wiki.debian.org/DebianSecurity/SpectreMeltdown03:30
salsburyoh nice, thanks gnarface03:32
salsbury:)03:32
gnarfacethere's a mention that you might need vendor firmware in some cases to make it work03:32
Weeazyreminds me I'm due to change the kernel on this box.03:33
gnarfaceoh03:33
gnarfacesalsbury: and then as i read that, i remembered reading this: https://linux.slashdot.org/story/18/11/24/2320228/two-linux-kernels-revert-performance-killing-spectre-patches#comments03:33
gnarfaceer, this i mean: https://linux.slashdot.org/story/18/11/24/2320228/two-linux-kernels-revert-performance-killing-spectre-patches03:33
salsburyhmmm that's interesting03:34
gnarfaceso it might be patched but disabled by default in some places, specifically because the kernel devs are complaining about poor performance03:35
salsbury4.9.139  onwards. ascii is using 4.9.130 I believe03:35
salsburyhmmm03:36
salsburyactually, you know what, I'm pretty sure the ascii kern is configured with that option ON03:36
salsburyunless I don't know what I'm looking at, and that happens ....often...03:37
gnarfaceyou might be right03:38
gnarfaceit looks like 4.18 is in the backports repo03:38
gnarfaceif you're looking for something else to compare performance to that would be a good thing to try03:38
gnarfacei'm not sure sure whether or not you might also need updated firmware from non-free and maybe even a bios flash too03:41
salsburybios? oh dear03:42
gnarfacei'm not sure about that.  cpu microcode can be updated just by package install, so maybe that's all you'll need.03:42
salsburymine's hast seen a new revision in ages03:42
gnarfacedo you have the non-free microcode package for your cpu?03:43
salsburyon devuan, don't think so...03:43
gnarfacethe other thing is that i don't really know enough about how this works to know if the patches might be worse without hypothetically expected corresponding microcode updates03:43
gnarfacei know a lot of people fly without them, but amd and intel both have been releasing microcode update packages even before all this spectre/meltdown vulnerability stuff, just to address other performance and stability problems03:45
salsburyoh actually yes, intel-microcode is present03:45
salsburyhmmm03:45
Weeazyhmm. yes. bios upgrade was available for my box too.03:45
Weeazyloathe to do it tho03:45
gnarfacei don't know if all vendors are providing that part03:45
gnarfacesalsbury: just make sure that package is up-to-date03:46
salsburystraight from ascii repo so...yes?03:46
gnarfacethat should be right, yes03:47
gnarfaceyou have security and updates/volatile added to your sources.list right?03:47
salsburynah, I don't think it's the meltdown thing03:47
salsburysecurity, yes03:48
salsburyI probably did something wrong03:48
gnarfacegot nvidia hardware?03:48
salsburyyep, why?03:49
gnarfaceyou might have accidentally switched to nouveau drivers during the upgrade, and that would noticeably hurt performance in a lot of cases03:49
salsbury840m with nouveau and bumblebeed (it's a laptop)03:49
salsburynah, had nouveau before as well03:50
gnarfaceok, if you're sure it's not that03:50
salsburyit's not graphics related03:50
salsburyhmm this looks promising http://lkml.iu.edu/hypermail/linux/kernel/1809.2/00897.html04:00
salsburytalking about NUMA...04:02
salsburyi did disable all iommu stuff04:03
salsburysince my cpu doesn't support it04:03
salsburybut maybe there's more to it like general memory management stuff04:04
gnarfacewhat is the ramdisk being created at boot for?04:04
gnarfacei've been told that most times it is better to use tmpfs04:04
salsburyoh it's right after grub04:05
salsburyit has always done that, even in 4.9, out of the box04:06
gnarfacereally?04:06
salsbury"Loading ramdisk..." or something04:06
gnarfaceyou aren't talking about the initrd.img are you?04:06
salsburyeh...04:06
gnarfacehmm, maybe you are though04:06
salsburyhmmm04:07
gnarfacei had a problem with that being too slow when booting from USB or SD card04:07
gnarfacenot so you should notice on faster media04:07
salsburybut if I boot with 4.9 I can notice it's way faster04:07
salsburymaybe the kernel is bigger04:08
gnarfacebut if you were booting from slow flash, a change to the setting of "include all drivers" or just "targeted drivers for this system" would noticeably increase boot times04:08
salsburythat might actually be it04:08
gnarfacethe difference in that setting can mean like a 500% increase in the size of the initrd.img04:08
salsburywait a sec04:08
salsburyLOL04:09
gnarfaceit's still only a dozen or so megabytes but at PIO speeds, that can be add up easily to a 2 minute boot delay04:09
salsburyyou're so right04:09
salsburynah, I done f***** up04:09
salsburylkololol04:10
gnarfacesomething else entirely, like accidentally adding the wrong path to something?04:10
salsburyinitrd.img size ---> 390MB04:10
salsburyprevious initrd.img size ---> 34MB04:11
gnarfaceoh boy04:12
salsburyyeah...04:12
gnarfacewell that looks... wrong04:12
salsburyawfully so04:12
gnarfacethe biggest one i have here is 23M04:13
gnarfacethe smallest is 16M04:13
gnarfaceon this machine, anyway04:13
salsburyI did enable a bunch of stuff... but as modules, it shouldn't be in initrd.img right?04:14
gnarfaceactually that's where the modules go.  they all go into initrd.img04:14
salsburyah crap04:14
salsburyI did not know that04:14
salsbury:D04:15
gnarfacestrictly speaking, you don't even need one.  but the default debian setup uses them so that it can preload drivers before the hardware that needs them04:15
salsburyI see04:15
gnarface(otherwise, stuff like your hdd controller driver and your network drivers would have to be statically built into the kernel to be accessible early enough in boot time)04:15
salsburywell, time to reconfigure it all again04:17
gnarfacehmmm04:17
salsburyhow did you get initrd.img so lean though?04:17
salsbury16M is pretty neat04:17
gnarfacethat's just the ones that came with the kernel04:17
salsburymy 4.9 is at 34M04:18
gnarfaceoh, no i guess the 16M one is a custom build04:18
gnarfaceyou're right04:18
gnarfacei must have shaved out some stuff i didn't need04:18
gnarfacei was using the debian kernel source packages04:18
salsburyhmmm04:18
gnarfaceso i just started with their config and then unchecked stuff i knew i didn't have04:18
gnarfacei think i was disabling debugging stuff, looking for more wine performance (didn't find any)04:19
salsburythat's interesting04:19
salsburyI used linus's source files... and I did check some kvm debug stuff as well04:20
gnarfacei seem to remember there was a command you could call to just trigger rebuilding the initrd.img with either the "all drivers" setting or just "targeted drivers for this system" setting, without actually rebuilding the entire kernel again.  i could be wrong....04:21
gnarface... also, i don't know how safe it would be to use on your custom build04:21
gnarfacei remember the setting was in a file in /etc/initramfs-tools/ though04:22
salsburyhmmm04:22
gnarfaceah yes, top of the /etc/initramfs-tools/initramfs.conf file04:23
gnarfaceMODULES:  [ most | netboot | dep | list ]04:23
salsburyyep04:24
salsburythat's it04:24
salsburymine's on "most"04:24
gnarfacethis one is too04:24
gnarfacehmmm04:25
salsburyI'm curious about the dep option04:25
salsburythough04:25
gnarfaceyea, they're all set to "most" here04:28
gnarfacethat's the default04:28
gnarfacei feel like i had to set it to "all" once, a long time ago due to a unrelated bug, but i guess i don't remember for sure04:28
gnarfaceanyway, i suspect this is something that's still dependent on your kernel build options04:29
golinuxtargz: I vaguely remember that site.  Sorry the ball got dropped.  I'll put it on the Wed. agenda04:29
salsburygnarface, I don't think I'll mess with that04:30
salsburyI done goofed up for sure, I'll compile it again04:30
gnarfacesalsbury: yea, don't change it yet, because that still wouldn't explain it being +350MB04:30
salsburyexactly04:30
targzgolinux: Don't worry04:30
salsburyoh well *shrugs*04:30
gnarfacesalsbury: lemme know if you figure out what did it.  i'm curious04:31
salsburysure ;)04:31
salsburybrb04:42
salsburygnarface: clue number 1: .config-4.9.0-8-amd64 only has one kerne hacking option. but doing menuconfig based on that enables a bunch more supported by 4.19.805:36
salsburybut this may be because I'm using linus src, not debian05:42
gnarfaceoh05:55
gnarfaceweird.  is it possible you have an initrd.img with multiple kernel versions' modules in it?05:55
gnarfacei didn't know that was a thing05:55
gnarfacehmmm05:56
gnarfaceor, wait, maybe i misunderstood that05:56
gnarfacemaybe it would be better to grab a debian config for 4.19 from ceres05:57
gnarfaceor well, from sid, either would do05:57
golinuxceres and sid are identical but best to access via devuan mirror06:11
golinuxgnarface: ^^^06:11
gnarfacethat's a good point06:12
_abc_fsmithred ?09:07
_abc_!seen fsmithred09:07
infobotfsmithred <~user@devuan/developer/fsmithred> was last seen on IRC in channel #devuan, 10h 33m 21s ago, saying: 'the new artists didn't learn about borders'.09:07
_abc_We/I need to make a statement of policy wrt firefox 60 and similar non-free things which run on devuan (default upgrade path) and cause security and usability problems to users. Also we/I need to establish some form of patch path to undo the damage soon. Perhaps using a user.js created and maintained under the devuan "umbrella", to be applied by users to forced-upgraded firefox. The patch should cover09:10
_abc_especially "default on"-can't turn off updates of all aspects of the browser, including search engines, and default push for "web based authentication" as well as "deprecation" of local file stored password saving and retrieval, in favor of "online (free)? service" data snooping service storage thereof.09:10
_abc_I feel this is important. There is no point in having a system which contains a trojan zero day horse, snitching everything one tries to do locally and all data to remote "benevolent" locations which just so happen to be in jurisdictions where this data can and is being copied and analyzed by third parties "legally", and without the knowledge or approval of the users. This even breaks EU gdpr. I am in EU.09:12
_abc_Will be back about this. If anyone has a way to store "patches" against current devuan/debian ff 60.3 ESR in a user.js, they, and discussion thereof is welcome.09:13
KatolaZ_abc_: please put together these patches and submit them for review09:29
_abc_I don't know how to extract what I changed in the prefs.js via about:config yet. I need to work on that later maybe tomorrow morning. If anyone has experience doing this somehow (sed, grep etc) please say so, a hint or two will save me a lot of time.09:31
amesser_abc_: Try looking at ~/.mozilla/firefox/<profile dir>/prefs.js. This file should contain all user changed settings09:38
amesser(and some timestamp/runtime stuff, but this should be extractable)09:40
KatolaZ_abc_: no idea, I don't use firefox09:49
KatolaZ(and the rare times I need it, are not enough to justify any tweaking for me)09:50
_abc_amesser: it contains all my changes and a lot more things. Separating my changes is hard. I need to install a fresh copy and then run some diff10:06
amesserdiff wont help for timestamps :-)10:06
amesserMy prefs.js is only about 130 lines. could be done manually but when its large10:09
amesserit might be an problem10:09
amesserwhat you could try is the following use awk to reform the file in a format like "<pref-name><space><value>"10:10
amesserthen use "cat my_prefs.txt initial_prefs.txt | sort | uniq -u"10:13
amesseri think the format should be "<pref-name>" (without the value)10:14
amesserthen u should see only the values which are in one of those files, not in bith10:14
amessers/bith/both10:14
_abc_amesser: yes, that will be done eventually, perhaps with a CSV or .cpp in-between step so things can ge selected by users. After all I do not want a new system which shoehorns people into new settings they do not understand, replacing the old settings which they do not understand.10:17
_abc_To be continued.10:17

Generated by irclog2html.py 2.17.0 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!