-
Junior Member
registered user
Practical compression advice needed (and a samba mystery)
Dear forum,
You guys have no idea how much you've helped me in the past when I have stumbled into Knoppix problems and scanned the forum. Thanx! This time though, I think I need to actually post my prob because I can not find a similar problem/request here or elsewhere. Its a general "usage" problem so I guess you don't have to be a hacker to give me some advice. So, here I go.
I am in charge of managing a couple of clustered Quantian 0.5.9.3 (http://dirk.eddelbuettel.com/quantian.html) boxes that we use for biological computation at my department, and to make regular backups of important files. The backups are meant to be transferred to a HP Windows NTFS-RAID server. The server is reachable with (tada!) samba. I have tried mirroring the important folders with rdiff-backup or rsync. But the first doesn't seem to work with a mounted samba drive and the second fails to transfer all files (I think due to odd characters in the file names - like : and ?) and permissions and ownership screws up anyways.
A bz2 compressed tar archive of these files weighs in at about 4 Gigs and can be produced in about two hours or so, which is ok if I do the backup weekly. However, copying such a file to the server is not possible because the copying-process stops after 2,0Gigs or 2 147 483 647 bytes! I have no idea where this limitation appears, but it's really a pain. Therefor I can use arj instead to produce multiple archives, each of which is smaller than 2,0 gigs. Which can then be transferred. However, I have only managed to run arj on a file or folder and not directly on a pipe from tar, which whould be much nicer and faster and requiring less free diskspace. Thus my horde of questions:
Do you think there is a way around the 2 Gig-transfer problem?
Can arj be used in a "tar <files> | arj <archive>" fashion?
Can any of the other free compression utilities like gzip and bzip2 create multiple archives? And of course then also be "piped to".
Am I missing a very different (and simple) solution to this problem?
Regards,
WedDa
Similar Threads
-
By djh-world in forum General Support
Replies: 3
Last Post: 02-15-2005, 07:08 PM
-
By eon in forum General Support
Replies: 0
Last Post: 12-05-2004, 05:54 PM
-
By Harry Kuhman in forum General Support
Replies: 1
Last Post: 11-25-2004, 04:41 PM
-
By rusty in forum Hardware & Booting
Replies: 5
Last Post: 05-23-2004, 05:25 AM
-
By ellen in forum Hardware & Booting
Replies: 3
Last Post: 11-04-2003, 12:53 AM
Posting Permissions
- You may not post new threads
- You may not post replies
- You may not post attachments
- You may not edit your posts
-
Forum Rules

Kingston 16GB DDR4 3200MHz PC4-3200AA-SA2-12 Laptop RAM SODIMM (HP32D4S2S8ME-16)
$64.99

16GB KIT (2x8GB) DDR4 Gamer Desktop RAM PC4 MIXED BRANDS
$65.00

Netac DDR4 32GB 16GB DDR4 3200MHz UDIMM C16 Desktop Internal Memory RAM Kit
$99.99

SK Hynix 8GB 1Rx8 PC4-2400T (HMA81GU6AFR8N-UH) DDR4 Desktop ram
$25.99
![[ BULK LOT OF 10 ] UNITS of 8GB DDR4 Laptop RAM SAMSUNG, HYNIX etc. picture](/store/img/g/IKQAAeSwEK9qv9TG/s-l225/-BULK-LOT-OF-10-UNITS-of-8GB-DDR4-Laptop-RAM-SAMSU.jpg)
[ BULK LOT OF 10 ] UNITS of 8GB DDR4 Laptop RAM SAMSUNG, HYNIX etc.
$299.99

SK hynix (4X 16GB) PC4-25600 (DDR4-2400) Memory (HMA82GR7AFR8N-XN) Tested
$400.00

16GB Kingston 2Rx8 PC4 2400 DDR4 SODIMM Laptop RAM 9995663-008 PC4-19200
$59.99

RAMAXEL Lenovo 32GB LPDDR5X CAMM2 7500MHz Laptop RAM | UNTESTED
$445.00

Corsair Vengeance DDR3 8GB 16GB 32GB 1866MHz PC3-14900 Desktop RAM Memory DIMM
$85.00

SMART(Micron)SafeStor 32GB(1X32GB) 1RX4 NN4-3200AA(DDR4) HPE Server Memory
$159.98