trivalto | hi all | 01:46 |
---|---|---|
trivalto | quick question ... i have setup a local "lan" mirror by serving out the contents of the desktop iso via http ... it mostly works via netboot but it will not pull the ata-modules-xxx.udeb | 01:47 |
trivalto | as a result the preseed autoconfiguration will not complete "no ahci drivers" | 01:48 |
trivalto | when I list an official mirror it all works well. | 01:48 |
trivalto | any ideas on how to fix the issue ?? | 01:48 |
crashoverride | configure your local http server to reverse proxy files from the official mirror when not found, before serving a 404. | 01:49 |
trivalto | thanks crashoverride | 01:49 |
crashoverride | you're very welcome. | 01:49 |
trivalto | but the packages are all there | 01:49 |
gnarface | it's probably that the desktop iso are too out of date after one networked system update | 01:49 |
gnarface | it's probably about versions | 01:49 |
gnarface | (and security patches) | 01:49 |
crashoverride | trivalto: wait, it will not pull the package that are there? | 01:49 |
trivalto | no all the missing .udebs are there but they live in the debian/pool | 01:50 |
crashoverride | ah. | 01:50 |
trivalto | no | 01:50 |
gnarface | anyway what you want is a caching proxy for apt, that is the correct answer. i would recommend apt-cacher-ng rather than something ad-hoc but ymmv. | 01:50 |
crashoverride | yeah this isn't an HTTP problem, but an apt problem. | 01:50 |
crashoverride | I'm sorry, I can't help you then :) | 01:50 |
crashoverride | what gnarface said seems sensible tho. | 01:51 |
trivalto | fair enough but this document https://pkgmaster.devuan.org/devuan_mirror_walkthrough.txt | 01:51 |
trivalto | seems to suggest it should be pretty easy to have a "local mirror" | 01:51 |
gnarface | yea a full mirror is also an option but it's really overkill | 01:52 |
trivalto | it is just a matter of redirects for all the software that is already there | 01:52 |
trivalto | there is nothing that the installer is looking for that is not already in that iso | 01:52 |
gnarface | that's what i'm not sure about though | 01:52 |
crashoverride | gnarface: wouldn't an HTTP reverse proxy fix that, too, then? | 01:53 |
gnarface | the packages may all be there by name but they might have too old of a package revision | 01:53 |
gnarface | crashoverride: yes, the functional difference in most cases will just be about how much disk space you need | 01:53 |
trivalto | ok I will look closely at that | 01:53 |
crashoverride | gnarface: fair enough. | 01:53 |
gnarface | trivalto: examine this line: ii libmjpegutils-2.1-0:amd64 1:2.1.0+debian-6 amd64 MJPEG capture/editing/replay and MPEG encoding toolset (library) | 01:53 |
trivalto | ok so instead is there an easy way to rsync only a single relase ... say beowulf | 01:54 |
gnarface | trivalto: actually examine just this part: 1:2.1.0+debian-6 | 01:54 |
trivalto | from where the /var/log/syslog of the install ?? | 01:54 |
trivalto | by the way, thanks to both of you guys, crashoverride and gnarface for your help | 01:55 |
gnarface | so the important part to know is that the part before the : is the debian package name major version, the part between the : and the + are the upstream version, and the part after the last "-" is the package build revision number < if there's a security fix this part may be the only part that actually iterates, but it can still cause dependency check fails | 01:55 |
crashoverride | I apparently didn't help much. | 01:55 |
crashoverride | but you're welcome. | 01:55 |
trivalto | hey, just replying and trying is very much appreciated | 01:55 |
gnarface | trivalto: i think there would be a way to rsync or wget from the repos but you have to find the right paths, i don't know off the top of my head... it would be easier probably to apt-get --download-only or something like that | 01:56 |
gnarface | really just running an apt proxy usually obviates all of this | 01:57 |
trivalto | would you guys think others would find this process useful ... I mean in a sysadmin multi server/desktop scenario this would be ideal ... without having to mess with mirrors | 01:57 |
fsmithred | that is the chimaera/ceres version of libmjpeg-2.1-0 | 01:58 |
gnarface | i think other people would find it useful but most of them also probably would be better off using a caching proxy... | 01:58 |
trivalto | so gnarface , apt-cacher-ng can work with an iso to make an apt proxy ?? | 01:58 |
gnarface | trivalto: it just works with whatever is in your sources.list, so yes, but the point would be you wouldn't have to | 01:58 |
trivalto | by proxy do you mean that it will just redirect to the actual mirrors on the net? because the whole point of what I am trying to do is keep 10 machines from going to the net and downloading the same software | 02:00 |
gnarface | trivalto: also, the obsessive focus on the iso part of this is the harmful part, because if you were going to make a local mirror you'd be better off using reprepro or the like anyway, to make an actual mirror you can manually update an individual package in without having to re-create a whole custom install iso with updated packages just so you could use the novel emergency source repo feature | 02:00 |
gnarface | trivalto: yea, that is exactly what the caching proxy would do; it would transparently only make one connection to the net for each package, then serve just that one package to an arbitrary amount of LAN peers | 02:00 |
trivalto | ok, obsessive might be a bit much, I was going for simplicity.. | 02:01 |
gnarface | trivalto: yes, i understand that, which is why i'm steering you away from stuff that is actually not the simplest approach | 02:01 |
trivalto | ok thanks | 02:01 |
trivalto | but I am still confused, does the proxy cache the packages locally (my lan) ?? | 02:02 |
gnarface | yea it uses some storage that it dynamically manages, but it has some configuration options | 02:02 |
trivalto | ok | 02:02 |
trivalto | that is great to know that is all I am looking for to save bandwidth ... | 02:02 |
gnarface | if you needed this to work fully offline, like on an air-gapped LAN you'd need an actual mirror like reprepo (reprepro is the only one i've tried but i know there are a few others available) | 02:03 |
gnarface | but even then you'd have to manage the packages on the repo manually | 02:03 |
trivalto | ok also good to know... I will give up on the iso/http route | 02:03 |
gnarface | i actually just had to set it up because the international cross-connects to the real mirrors aren't reliable to my country | 02:04 |
trivalto | wow. great ... so kindred spirits... :) | 02:04 |
trivalto | are you using preseed/ansible ?? | 02:05 |
gnarface | nah, but i have worked with preseeding a little | 02:05 |
gnarface | just briefly really | 02:05 |
trivalto | ok | 02:05 |
gnarface | so i'm familiar with the basic idea | 02:05 |
gnarface | you gotta load a package list but that package list has to have the right versions available | 02:06 |
gnarface | so if that changes upstream, an iso would have to be updated to match it | 02:06 |
gnarface | completely doable but the iso creation is an unnecessary step that would have to be repeated | 02:06 |
trivalto | yeah, It has been really hard to figure out how the whole process actually works ... even the debina di-netboot-assistant lists and ISO as one of the things you can server over the lan | 02:06 |
trivalto | but when I actually tried it .. it did not work | 02:07 |
gnarface | i get the picture even they rarely use it anymore, it's kindof a vestigial feature | 02:07 |
trivalto | but that might be just my incompetence | 02:07 |
gnarface | well i think the documentation might be a bit stale and incomplete | 02:07 |
trivalto | fair enough.. | 02:07 |
trivalto | correct me if I am wrong ... does the iso not pull newer packages during the install ?? | 02:08 |
trivalto | if there are any ?? | 02:08 |
gnarface | the netinstall one does, they don't all though | 02:08 |
trivalto | ah ok | 02:08 |
fsmithred | you can choose whether to use a mirror or not | 02:08 |
trivalto | cheers, again many thanks | 02:09 |
gnarface | maybe you need to be in expert mode to be asked that, i'm not sure | 02:12 |
fsmithred | I don't remember | 02:12 |
fsmithred | I think it always asks to select a mirror | 02:13 |
Jjp137 | from the Devuan install guide online it seems to be the case | 02:19 |
EHeM | I tend to use the approach | 02:40 |
EHeM | Erk. | 02:40 |
EHeM | I'm aware of /var/cache/apt/archives, I tend to download the packages, then copy them to other systems; for my network size it is effective. | 02:41 |
EHeM | The country mirrors which point to pkgmaster presently give 404 for the Release file though. | 02:44 |
rwp | trivalto, Reading the scrollback... If you are trying to keep bandwidth minimized then I recommend and use myself apt-cacher-ng as the best that is available at this time. | 02:49 |
rwp | If you must be able to operate disconnected then best is a full mirror. That will need the full amount of disk space for the entire repository. | 02:50 |
trivalto | thanks rwp | 02:50 |
rwp | For a full mirror the upstream is "ftpsync" but frankly I have been using "debmirror" as the best just to make partial mirrors. | 02:50 |
rwp | If you decide to try debmirror if you ping me I will share the scripts I use around it as that would probably help getting all of the options you need for making it a full network bootable repository. | 02:51 |
trivalto | so rwp can I ask do you use di-netboot-assistant ?? | 02:52 |
rwp | But lately I pretty much use apt-cacher-ng as that is good enough for me. | 02:52 |
rwp | I am not using di-netboot-assistant. Actually have never heard of it before. (me go to search...) | 02:52 |
trivalto | it basically just takes care of the pxelinux.0 pxelinux.cfg stuff | 02:53 |
trivalto | for pxe network boot install | 02:53 |
rwp | For PXE booting I have always just done it the traditional way. I can't even remember now and will have to refresh my memory of my setup. | 02:53 |
rwp | I make small customizations to the initrd by concatenation and for that have a script called from make to make it super trivial for me. | 02:54 |
trivalto | yeah, ideally I wanted to use ipxe with the memdisk option for iso... | 02:54 |
trivalto | but that does not allow preseed stuff | 02:54 |
trivalto | from my understanding ... | 02:54 |
trivalto | the other interesting route is booting an ISO via ipxe and their ATA over ethernet option... still researching this option | 02:55 |
trivalto | i have a few coreboot machines and they all start via ipxe .... with localboot as primary selection . | 02:56 |
rwp | There are a small number of preseed items that can't be answered otherwise and I add the preseed.cfg file for those things into the initrd. But leave all of the rest to another preseed file I can update more often. | 02:57 |
trivalto | ah yes.. I was going to try the preseed in initrd next | 02:57 |
rwp | debian-installer/locale console-keymaps-at/keymap keyboard-configuration/xkb-keymap netcfg/choose_interface are the only four items I have in the initrd preseed file. | 02:58 |
rwp | But those do vary somewhat from major OS release to release. But all of the rest can be configured in the separate preseed file. | 02:59 |
trivalto | ah ok... | 02:59 |
rwp | The other perhaps not so obvious thing is that the cpio format used for initrd (as of Stretch, haven't updated for Beowulf) can be concatenated. | 03:00 |
rwp | Which means that instead of unpacking and modifying and repackaging it one can simply package up incremental small cpio files and then concatenate them onto the end of the original upstream one. | 03:00 |
trivalto | ah geez .. you really know quite a bit about that part of it all | 03:01 |
rwp | Which makes updating them very easy. Download a new upstream one and then concatenate the local additions onto the end of it with an append action (cat l1 l2 l3 >> initrd) and it works. | 03:01 |
trivalto | nice ... | 03:01 |
rwp | I need to update everything for Beowulf and then I will find out what has changed. But I haven't been using it for Beowulf and so haven't had to scratch the itch yet. | 03:02 |
trivalto | :) | 03:02 |
rwp | I don't know why but it took me forever to run into the documentation that told me I could concatenate initrd files. Prior to that time I was doing the unpack-modify-pack action. | 03:02 |
trivalto | maybe because it's such a niche need .... | 03:03 |
rwp | I think the Refracta installer is the smarter way to do things. I believe it simply copies the file system into place file by file. I think. | 03:03 |
trivalto | don't know much about that | 03:04 |
trivalto | i am surprised that there is not a simple nfs install | 03:04 |
rwp | There is an NFS installation option documented somewhere. I have not ever used it. | 03:05 |
trivalto | oh shit ... that might be super useful to me | 03:05 |
rwp | As a by the by... Here is the script I use to build my custom PXE initrd. https://paste.debian.net/plain/1193927 | 03:07 |
trivalto | cheers, and thanks | 03:07 |
trivalto | by the way all ... I think i just figured out the problem ... it's not a mirror problem ... the reason the ata-modules are not loaded is because the netboot packages uses kernel 4.19.0-16 while the iso contents are for 4.19.0-14 | 03:35 |
trivalto | debian knows this is a big problem | 03:35 |
trivalto | https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=749991 | 03:35 |
trivalto | great community you guys have here ... many thanks again | 03:37 |
rwp | Hmm... That bug was opened in 2014 and closed in 2019. | 03:45 |
crashoverride | I was stuck in the log | 03:46 |
crashoverride | and I was like "gosh, this is weird, this chan has activity but they are repeating themselves a lot" | 03:46 |
crashoverride | I think I might need sleep. | 03:46 |
crashoverride | rwp: still faster than duke nukem forever, amarite? | 03:47 |
golinux | Please go get some rest | 03:47 |
trivalto | Hi all ... | 08:34 |
trivalto | does anyone know if there is a listing of all the software in each cdrom ?? | 08:35 |
cronolio | there is in mirror Packages.gz for example http://pkgmaster.devuan.org/devuan/dists/chimaera/main/binary-all/ | 09:39 |
cronolio | not sure id it present on cd | 09:39 |
rrq | trivalto: the installable packages carried on installation isos are all in their respective "pool" directory tree ; there's no published listing | 09:58 |
zalckos | how would I use the hostnamectl equivalent on devuan? | 11:00 |
Joril | zalckos: hostname <new_hostname> for a temporary change, edit /etc/hostname to make it permanent | 11:04 |
zalckos | ah, but the goal is to have a random hostname on every bootup | 11:06 |
zalckos | I'll take a look | 11:06 |
zalckos | thank you | 11:06 |
zalckos | sorry for asking all these questions, but how do I run a script from boot, preferably as root? | 11:34 |
gnarface | check out /etc/rc.local | 11:35 |
onefang | Run it from /etc/rc.local | 11:35 |
onefang | SNAP! | 11:35 |
zalckos | so copy the bash script to /etc/rc.local? | 11:35 |
gnarface | or just call it from there, it matters very little | 11:35 |
zalckos | ah ty | 11:36 |
gnarface | also, everything that's run at boot is run by root unless you specify otherwise | 11:36 |
zalckos | cool good to know | 11:36 |
zalckos | ok, brb | 11:37 |
zalckos | everything worked nicely, ty | 11:39 |
zalckos | incase anyone is interested in the script: https://paste.debian.net/1193953/ | 11:40 |
pablocastellanos | Don't know if this is the place to ask, when I use the netinst CD, it asks for two options for the initrd, an initrd for the specific installation and a more general initrd. What is different? More modules? How can I recreate any of the two initrds? | 20:08 |
fsmithred | pablocastellanos, I recently came across the answer to this. There's a file created somewhere. I'll try to remember. | 20:16 |
pablocastellanos | fsmithred: Thank you!! | 20:21 |
fsmithred | still looking | 20:21 |
fsmithred | pablocastellanos, /etc/initramfs-tools/conf.d/driver-policy | 20:49 |
fsmithred | if you select targeted drivers, that file gets created. To undo it, you would remove that file and run 'update-initramfs -u' | 20:50 |
pablocastellanos | fsmithred: Oooh. Thank you very much!! | 21:00 |
fsmithred | pablocastellanos, two possible reasons for including all modules would be 1) in case you ever want to put the hard drive into another computer. 2) in case you wanted to make a disk image or live iso copy of the system to share with others. | 21:08 |
Generated by irclog2html.py 2.17.0 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!