testing 3.9 w/ unionfs and apt-get update, upgrade- problems

[nosknoppix]

Hi all,

I've got the latest 3.9 release up on a vmware instance, and have sucessfully? merged a read-write disk to the ro distribution via the excellent-sounding unionfs.

If this sucker behaves well it may start assimilating large portions of the server infrastructure at the company where I work - yummy.

apt-get, however, is not happy with the situation - the 'update' goes fine, the 'upgrade' identifies a bunch of packages, they seem to get downloaded into the KNOPPIX.IMG area of the unionfs, but then there seem to be filesystem errors when dpkg starts trying to install them:

failed in buffer_read(fd): files list for package `xf86config-knoppix': Input/output error

I've enclosed a df and the logs of the apt operations.

Bug in the union filesystem?

root@0[knoppix]# df
Filesystem 1K-blocks Used Available Use% Mounted on
/dev/root 3471 14 3457 1% /
/dev/sda2 719452 713020 0 100% /cdrom
/dev/cloop 1966628 1966628 0 100% /KNOPPIX
/ramdisk 230352 2668 227684 2% /ramdisk
/UNIONFS 2974524 2070160 904364 70% /UNIONFS
/UNIONFS/dev/sda1 1266612 1024004 242608 81% /mnt/sda1
/mnt/sda1/knoppix.img
1007896 103532 904364 11% /KNOPPIX.IMG
persistent 2974524 2070160 904364 70% /UNIONFS


root@0[knoppix]# apt-get update; apt-get upgrade
Hit http://pkg-kde.alioth.debian.org ./ Packages
Hit http://pkg-kde.alioth.debian.org ./ Release
Hit http://pkg-kde.alioth.debian.org ./ Sources
Hit http://pkg-kde.alioth.debian.org ./ Release
Hit http://ftp.de.debian.org stable/main Packages
Hit http://ndiswrapper.sourceforge.net ./ Packages
Get:1 http://ftp.de.debian.org stable/main Release [95B]
Hit http://ftp.de.debian.org stable/contrib Packages
Get:2 http://ftp.de.debian.org stable/contrib Release [98B]
Hit http://ftp.de.debian.org stable/non-free Packages
Get:3 http://ftp.de.debian.org stable/non-free Release [99B]
Hit http://ftp.de.debian.org stable/non-US/main Packages
Hit http://ftp.de.debian.org stable/non-US/main Release
Hit http://ftp.de.debian.org stable/non-US/contrib Packages
Hit http://ftp.de.debian.org stable/non-US/contrib Release
Ign http://ndiswrapper.sourceforge.net ./ Release
Hit http://ftp.de.debian.org stable/non-US/non-free Packages
Hit http://ftp.de.debian.org stable/non-US/non-free Release
Get:4 http://ftp.de.debian.org testing/main Packages [3347kB]
Get:5 http://security.debian.org stable/updates/main Packages [238kB]
Get:6 http://security.debian.org stable/updates/main Release [110B]
Hit http://security.debian.org stable/updates/contrib Packages
Get:7 http://security.debian.org stable/updates/contrib Release [113B]
Hit http://security.debian.org stable/updates/non-free Packages
Get:8 http://security.debian.org stable/updates/non-free Release [114B]
Hit http://security.debian.org testing/updates/main Packages
Get:9 http://security.debian.org testing/updates/main Release [111B]
Hit http://security.debian.org testing/updates/contrib Packages
Get:10 http://security.debian.org testing/updates/contrib Release [114B]
Hit http://security.debian.org testing/updates/non-free Packages
Get:11 http://security.debian.org testing/updates/non-free Release [115B]
Get:12 http://ftp.de.debian.org testing/main Release [81B]
Get:13 http://ftp.de.debian.org testing/contrib Packages [56.2kB]
Get:14 http://ftp.de.debian.org testing/contrib Release [84B]
Get:15 http://ftp.de.debian.org testing/non-free Packages [58.4kB]
Get:16 http://ftp.de.debian.org testing/non-free Release [85B]
Hit http://ftp.de.debian.org testing/non-US/main Packages
Hit http://ftp.de.debian.org testing/non-US/main Release
Hit http://ftp.de.debian.org testing/non-US/contrib Packages
Hit http://ftp.de.debian.org testing/non-US/contrib Release
Hit http://ftp.de.debian.org testing/non-US/non-free Packages
Hit http://ftp.de.debian.org testing/non-US/non-free Release
Get:17 http://ftp.de.debian.org unstable/main Packages [3566kB]
Get:18 http://ftp.de.debian.org unstable/main Release [82B]
Get:19 http://ftp.de.debian.org unstable/contrib Packages [69.0kB]
Get:20 http://ftp.de.debian.org unstable/contrib Release [85B]
Get:21 http://ftp.de.debian.org unstable/non-free Packages [67.2kB]
Get:22 http://ftp.de.debian.org unstable/non-free Release [86B]
Hit http://ftp.de.debian.org unstable/non-US/main Packages
Hit http://ftp.de.debian.org unstable/non-US/main Release
Hit http://ftp.de.debian.org unstable/non-US/contrib Packages
Hit http://ftp.de.debian.org unstable/non-US/contrib Release
Hit http://ftp.de.debian.org unstable/non-US/non-free Packages
Hit http://ftp.de.debian.org unstable/non-US/non-free Release
Get:23 http://ftp.de.debian.org ../project/experimental/main Packages [221kB]
Get:24 http://ftp.de.debian.org ../project/experimental/main Release [104B]
Get:25 http://ftp.de.debian.org ../project/experimental/contrib Packages [4073B]
Get:26 http://ftp.de.debian.org ../project/experimental/contrib Release [107B]
Hit http://ftp.de.debian.org ../project/experimental/non-free Packages
Get:27 http://ftp.de.debian.org ../project/experimental/non-free Release [108B]
Fetched 7627kB in 36s (208kB/s)
Reading Package Lists... Done
Reading Package Lists... Done
Building Dependency Tree... Done
The following packages have been kept back:
lilo mknbi pppconfig tasksel
The following packages will be upgraded:
arj bittorrent fdutils gaim gaim-data libdps1 libice-dev libice6 libid3tag0 libmad0 libmad0-dev libsm-dev
libsm6 libusb-0.1-4 libusb-dev libwine libwine-print libwine-twain libx11-6 libx11-dev libxaw7 libxaw7-dev
libxext-dev libxext6 libxft1 libxi-dev libxi6 libxmu-dev libxmu6 libxmuu-dev libxmuu1 libxp-dev libxp6
libxpm-dev libxpm4 libxrandr-dev libxrandr2 libxt-dev libxt6 libxtrap-dev libxtrap6 libxtst-dev libxtst6
libxv-dev libxv1 pm-dev raidtools2 twm unarj usbutils wine wine-utils x-dev xbase-clients xdm
xfonts-100dpi xfonts-100dpi-transcoded xfonts-75dpi xfonts-75dpi-transcoded xfonts-base
xfonts-base-transcoded xfonts-scalable xfree86-common xlibmesa-dri xlibmesa-gl xlibmesa-gl-dev
xlibmesa-glu xlibmesa-glu-dev xlibs xlibs-data xlibs-dev xlibs-static-dev xlibs-static-pic xnest
xserver-common xserver-xfree86 xterm xutils
78 upgraded, 0 newly installed, 0 to remove and 4 not upgraded.
Need to get 83.8MB of archives.
After unpacking 317kB disk space will be freed.
Do you want to continue? [Y/n] y
Get:1 http://ftp.de.debian.org unstable/main arj 3.10.21-4 [217kB]
Get:2 http://ftp.de.debian.org testing/main bittorrent 3.4.2-3sarge0.1 [88.4kB]
Get:3 http://ftp.de.debian.org unstable/main fdutils 5.5-20050303-1 [347kB]
Get:4 http://ftp.de.debian.org unstable/main gaim 1:1.3.0-2 [885kB]
Get:5 http://ftp.de.debian.org unstable/main gaim-data 1:1.3.0-2 [2928kB]
Get:6 http://ftp.de.debian.org testing/main xfree86-common 4.3.0.dfsg.1-14 [815kB]
Get:7 http://ftp.de.debian.org testing/main x-dev 4.3.0.dfsg.1-14 [216kB]
Get:8 http://ftp.de.debian.org testing/main libice-dev 4.3.0.dfsg.1-14 [205kB]
Get:9 http://ftp.de.debian.org testing/main libice6 4.3.0.dfsg.1-14 [203kB]
Get:10 http://ftp.de.debian.org testing/main libsm-dev 4.3.0.dfsg.1-14 [176kB]
Get:11 http://ftp.de.debian.org testing/main libsm6 4.3.0.dfsg.1-14 [181kB]
Get:12 http://ftp.de.debian.org testing/main libxext-dev 4.3.0.dfsg.1-14 [246kB]
Get:13 http://ftp.de.debian.org testing/main libxext6 4.3.0.dfsg.1-14 [188kB]
Get:14 http://ftp.de.debian.org testing/main libxi-dev 4.3.0.dfsg.1-14 [231kB]
Get:15 http://ftp.de.debian.org testing/main libxi6 4.3.0.dfsg.1-14 [179kB]
Get:16 http://ftp.de.debian.org testing/main libxv-dev 4.3.0.dfsg.1-14 [190kB]
Get:17 http://ftp.de.debian.org testing/main libxv1 4.3.0.dfsg.1-14 [172kB]
Get:18 http://ftp.de.debian.org testing/main xlibs-static-pic 4.3.0.dfsg.1-14 [384kB]
Get:19 http://ftp.de.debian.org testing/main xlibs-static-dev 4.3.0.dfsg.1-14 [854kB]
Get:20 http://ftp.de.debian.org testing/main libx11-dev 4.3.0.dfsg.1-14 [1358kB]
Get:21 http://ftp.de.debian.org testing/main xlibs-data 4.3.0.dfsg.1-14 [906kB]
Get:22 http://ftp.de.debian.org testing/main libx11-6 4.3.0.dfsg.1-14 [725kB]
Get:23 http://ftp.de.debian.org testing/main libxft1 4.3.0.dfsg.1-14 [190kB]
Get:24 http://ftp.de.debian.org testing/main libxt-dev 4.3.0.dfsg.1-14 [614kB]
Get:25 http://ftp.de.debian.org testing/main libxt6 4.3.0.dfsg.1-14 [329kB]
Get:26 http://ftp.de.debian.org testing/main libxmu-dev 4.3.0.dfsg.1-14 [218kB]
Get:27 http://ftp.de.debian.org testing/main libxmu6 4.3.0.dfsg.1-14 [209kB]
Get:28 http://ftp.de.debian.org testing/main libxmuu-dev 4.3.0.dfsg.1-14 [162kB]
Get:29 http://ftp.de.debian.org testing/main libxmuu1 4.3.0.dfsg.1-14 [171kB]
Get:30 http://ftp.de.debian.org testing/main libxp-dev 4.3.0.dfsg.1-14 [178kB]
Get:31 http://ftp.de.debian.org testing/main libxp6 4.3.0.dfsg.1-14 [178kB]
Get:32 http://ftp.de.debian.org testing/main libxpm-dev 4.3.0.dfsg.1-14 [193kB]
Get:33 http://ftp.de.debian.org testing/main libxpm4 4.3.0.dfsg.1-14 [195kB]
Get:34 http://ftp.de.debian.org testing/main libxrandr-dev 4.3.0.dfsg.1-14 [170kB]
Get:35 http://ftp.de.debian.org testing/main libxrandr2 4.3.0.dfsg.1-14 [171kB]
Get:36 http://ftp.de.debian.org testing/main libxtrap-dev 4.3.0.dfsg.1-14 [184kB]
Get:37 http://ftp.de.debian.org testing/main libxtrap6 4.3.0.dfsg.1-14 [180kB]
Get:38 http://ftp.de.debian.org testing/main libxtst-dev 4.3.0.dfsg.1-14 [169kB]
Get:39 http://ftp.de.debian.org testing/main libxtst6 4.3.0.dfsg.1-14 [174kB]
Get:40 http://ftp.de.debian.org testing/main xlibs 4.3.0.dfsg.1-14 [417kB]
Get:41 http://ftp.de.debian.org testing/main libdps1 4.3.0.dfsg.1-14 [286kB]
Get:42 http://ftp.de.debian.org unstable/main libid3tag0 0.15.1b-7 [35.3kB]
Get:43 http://ftp.de.debian.org unstable/main libmad0-dev 0.15.1b-2.1 [85.6kB]
Get:44 http://ftp.de.debian.org unstable/main libmad0 0.15.1b-2.1 [74.8kB]
Get:45 http://ftp.de.debian.org unstable/main libusb-dev 2:0.1.10a-14 [35.9kB]
Get:46 http://ftp.de.debian.org unstable/main libusb-0.1-4 2:0.1.10a-14 [22.1kB]
Get:47 http://ftp.de.debian.org unstable/main libwine-twain 0.0.20050524-1 [1161kB]
Get:48 http://ftp.de.debian.org testing/main libxaw7-dev 4.3.0.dfsg.1-14 [414kB]
Get:49 http://ftp.de.debian.org testing/main libxaw7 4.3.0.dfsg.1-14 [338kB]
Get:50 http://ftp.de.debian.org testing/main xlibmesa-gl-dev 4.3.0.dfsg.1-14 [705kB]
Get:51 http://ftp.de.debian.org testing/main xlibmesa-gl 4.3.0.dfsg.1-14 [283kB]
Get:52 http://ftp.de.debian.org testing/main xlibmesa-glu-dev 4.3.0.dfsg.1-14 [434kB]
Get:53 http://ftp.de.debian.org testing/main xlibmesa-glu 4.3.0.dfsg.1-14 [365kB]
Get:54 http://ftp.de.debian.org testing/main xbase-clients 4.3.0.dfsg.1-14 [1940kB]
Get:55 http://ftp.de.debian.org unstable/main wine 0.0.20050524-1 [1422kB]
Get:56 http://ftp.de.debian.org unstable/main wine-utils 0.0.20050524-1 [1661kB]
Get:57 http://ftp.de.debian.org unstable/main libwine-print 0.0.20050524-1 [1259kB]
Get:58 http://ftp.de.debian.org unstable/main libwine 0.0.20050524-1 [11.4MB]
Get:59 http://ftp.de.debian.org testing/main pm-dev 4.3.0.dfsg.1-14 [159kB]
Get:60 http://ftp.de.debian.org testing/main raidtools2 1.00.4 [3064B]
Get:61 http://ftp.de.debian.org testing/main twm 4.3.0.dfsg.1-14 [264kB]
Get:62 http://ftp.de.debian.org unstable/main unarj 3.10.21-4 [21.0kB]
Get:63 http://ftp.de.debian.org unstable/main usbutils 0.71-2 [91.4kB]
Get:64 http://ftp.de.debian.org testing/main xdm 4.3.0.dfsg.1-14 [308kB]
Get:65 http://ftp.de.debian.org testing/main xutils 4.3.0.dfsg.1-14 [911kB]
Get:66 http://ftp.de.debian.org testing/main xfonts-100dpi 4.3.0.dfsg.1-14 [4362kB]
Get:67 http://ftp.de.debian.org testing/main xfonts-100dpi-transcoded 4.3.0.dfsg.1-14 [8197kB]
Get:68 http://ftp.de.debian.org testing/main xfonts-75dpi 4.3.0.dfsg.1-14 [3840kB]
Get:69 http://ftp.de.debian.org testing/main xfonts-75dpi-transcoded 4.3.0.dfsg.1-14 [7074kB]
Get:70 http://ftp.de.debian.org testing/main xfonts-base 4.3.0.dfsg.1-14 [5490kB]
Get:71 http://ftp.de.debian.org testing/main xfonts-base-transcoded 4.3.0.dfsg.1-14 [1203kB]
Get:72 http://ftp.de.debian.org testing/main xfonts-scalable 4.3.0.dfsg.1-14 [900kB]
Get:73 http://ftp.de.debian.org testing/main xlibmesa-dri 4.3.0.dfsg.1-14 [5009kB]
Get:74 http://ftp.de.debian.org testing/main xserver-common 4.3.0.dfsg.1-14 [336kB]
Get:75 http://ftp.de.debian.org testing/main xnest 4.3.0.dfsg.1-14 [1466kB]
Get:76 http://ftp.de.debian.org testing/main xserver-xfree86 4.3.0.dfsg.1-14 [5742kB]
Get:77 http://ftp.de.debian.org testing/main xterm 4.3.0.dfsg.1-14 [509kB]
Get:78 http://ftp.de.debian.org testing/main xlibs-dev 4.3.0.dfsg.1-14 [158kB]
Fetched 83.8MB in 6m9s (227kB/s)
Preconfiguring packages ...
(Reading database ... dpkg: error processing /var/cache/apt/archives/arj_3.10.21-4_i386.deb (--unpack):
failed in buffer_read(fd): files list for package `xf86config-knoppix': Input/output error
Errors were encountered while processing:
/var/cache/apt/archives/arj_3.10.21-4_i386.deb
Processing was halted because there were too many errors.
E: Sub-process /usr/bin/dpkg returned an error code (1)
root@0[knoppix]#

[UnderScore]

You may want to refer to the Knoppix 3.9 bugs in the wiki as one of them is similar to the behavior you are seeing.

[nosknoppix]

Thanks for the response and the links to the wiki.

The initial problem I described was solved by integrity checking/re imaging of the knoppix filesystem. Don't blame unionfs when simpler things explain the problem...

However, I now get a consistent (completely frozen linux) hang during the apt-get upgrade process when xlibs-dev (I believe) is being installed, sounds like the bug that was mentioned in the wiki.

BTW, The knoppix instance hangs regardless of whether X is active or not ( 'init 3' and working from a console does not help).