-
Quantian clustering
Not sure if this is the right forum for this but I'll give it a shot and prepare to be moved
So I am building a fairly large cluster (~60 node) for the quantum computing lab at my school... and I was hoping to get some help with some of the configurations that I am struggling with... The requirements for the cluster are: 1) the IPs for the nodes are statically assigned based on MAC... 2) the DVD be copied to the HD and used to boot the nodes (this should be easy but for some reason I am struggling with it)... 3) the hard drive should be shared over the network so that work done on the cluster can be stored there and accessed via SSH... any thoughts would be most appreciated and thanks in advance =)
PS... well, it looks like fixed mapping is achieved via the PXE config on the server... editting the /etc/dhcpd.conf file... but openmosix overwrites this file when it starts... intriguing problems...
-
Senior Member
registered user
Do search for ClusterKnoppix, Quantain is based on it.
1. I have come to the same conclusion about the dhcp being overwritten. It seems like a good way to bind the MAC to a IP address for a diskless node. I am currently booting nodes from a short script. It uses etherwake+MAC and sleep command to boot the nodes in a timed orderly fashion. Along with the Terminal server allocating ip address in a decending manner. Default ip is 192.168.0.200, next 192.168.0.199, ect. It works by giving the same IP to the same MAC address. It's not great but it works. I have also have had NFS mount get "swamped" by to many nodes booting at once. Some of the nodes will wind up as zombies...
I also shut them down with a script. To boot again correctly, they need to be powered down to a "warm" state. The command that works for me is "ssh NODE halt -p -d -i -f"
2. Many have struggled with a hard drive install. There is an * missing from the Knoppix-terminalopenmosix script. Search this forum for a more detailed answer.
3. I was able to shorten the node boot times considerably :
"gethostip 192.168.0.200"
C0A800C8
create a file with this name and copy the pxelinux.default to it. Place it in the pxelinux directory. Now the node wont nibble slowly away at the ip address it skips straight to default. While this is good it dosent bind it to a MAC address as far as I can tell.
johnb
-
thank you for the ideas =)
i switched the cluster over to clusterKnoppix since it really doesn't matter... I was able to get the HD to hold the boot image for the nodes... and I am intrigued by the idea of powering them on in order like you mentioned... what sort of script was it (if you don't mind sharing) that enabled you to do that?
I also am a bit confused about the procedure to shorten boot time... I understand what you are getting at with the creating of a file so the node doesn't try to trim away at the address... is the file name just those 8 characters? thank you again for your help
-david
-
Senior Member
registered user
I will post a pretty good how-to soon.
sorry my time is short at the moment
johnb
Similar Threads
-
By A. Jorge Garcia in forum Other Live CDs
Replies: 1
Last Post: 06-19-2007, 06:29 PM
-
By dvryknopper in forum The Lounge
Replies: 3
Last Post: 05-15-2006, 02:23 AM
-
By Kermit42 in forum Hdd Install / Debian / Apt
Replies: 0
Last Post: 03-02-2005, 01:38 PM
-
By aznchowboy650 in forum General Support
Replies: 5
Last Post: 01-19-2005, 01:34 AM
-
By edd in forum Customising & Remastering
Replies: 11
Last Post: 05-01-2004, 01:38 AM
Posting Permissions
- You may not post new threads
- You may not post replies
- You may not post attachments
- You may not edit your posts
-
Forum Rules
![Samsung 16GB 1Rx8 DDR5 5600MHz EC8 RDIMM PC5-44800 Memory RAM (M321R2GA3PB0-CWM) picture](/store/img/g/hTkAAOSwFb5mIuVF/s-l225/Samsung-16GB-1Rx8-DDR5-5600MHz-EC8-RDIMM-PC5-44800.jpg)
Samsung 16GB 1Rx8 DDR5 5600MHz EC8 RDIMM PC5-44800 Memory RAM (M321R2GA3PB0-CWM)
$99.99
![A-Tech 8GB DDR3 1600 PC3-12800 Laptop SODIMM 204-Pin Memory RAM PC3L DDR3L 1x 8G picture](/store/img/g/RCAAAOSweqdeWaui/s-l225/A-Tech-8GB-DDR3-1600-PC3-12800-Laptop-SODIMM-204-P.jpg)
A-Tech 8GB DDR3 1600 PC3-12800 Laptop SODIMM 204-Pin Memory RAM PC3L DDR3L 1x 8G
$13.99
![Crucial DDR3L 16GB 1600 2x 8GB PC3-12800 Laptop SODIMM Memory RAM PC3 16G DDR3 picture](/store/img/g/mecAAOSw2Vlkv6Ot/s-l225/Crucial-DDR3L-16GB-1600-2x-8GB-PC3-12800-Laptop-SO.jpg)
Crucial DDR3L 16GB 1600 2x 8GB PC3-12800 Laptop SODIMM Memory RAM PC3 16G DDR3
$22.45
![8GB PC3L-12800S 1600MHz SODIMM DDR3 RAM | Grade A picture](/store/img/g/tmAAAOSwxu1mDNSQ/s-l225/8GB-PC3L-12800S-1600MHz-SODIMM-DDR3-RAM-Grade-A.jpg)
8GB PC3L-12800S 1600MHz SODIMM DDR3 RAM | Grade A
$12.00
![Team T-FORCE VULCAN Z 32GB (2 x 16GB) PC RAM DDR4 3200 (PC4 25600) Memory picture](/store/img/g/~u4AAOSwK-liKn7t/s-l225/Team-T-FORCE-VULCAN-Z-32GB-2-x-16GB-PC-RAM-DDR4-32.jpg)
Team T-FORCE VULCAN Z 32GB (2 x 16GB) PC RAM DDR4 3200 (PC4 25600) Memory
$54.99
![HyperX FURY DDR3 8GB 16GB 32GB 1600 MHz PC3-12800 Desktop RAM Memory DIMM 240pin picture](/store/img/g/XNYAAOSwg81kv6CG/s-l225/HyperX-FURY-DDR3-8GB-16GB-32GB-1600-MHz-PC3-12800-.jpg)
HyperX FURY DDR3 8GB 16GB 32GB 1600 MHz PC3-12800 Desktop RAM Memory DIMM 240pin
$15.90
![Team T-FORCE VULCAN Z 16GB (2 x 8GB) 288-Pin PC RAM DDR4 3200 (PC4 25600) Intel picture](/store/img/g/uPEAAOSw0-1mBgnN/s-l225/Team-T-FORCE-VULCAN-Z-16GB-2-x-8GB-288-Pin-PC-RAM-.jpg)
Team T-FORCE VULCAN Z 16GB (2 x 8GB) 288-Pin PC RAM DDR4 3200 (PC4 25600) Intel
$33.99
![Crucial 16GB (2x 8GB) Kit DDR3L 1600MHz PC3-12800 UDIMM Desktop 240-Pin CL11 RAM picture](/store/img/g/kk4AAOSwKcplp0xR/s-l225/Crucial-16GB-2x-8GB-Kit-DDR3L-1600MHz-PC3-12800-UD.jpg)
Crucial 16GB (2x 8GB) Kit DDR3L 1600MHz PC3-12800 UDIMM Desktop 240-Pin CL11 RAM
$22.85
![Apple MacBook Air (2020) 13.3-inch, 1.1GHz, i5, 8GB RAM, 512GB SSD, Space Gray picture](/store/img/g/2sMAAOSwO4JmaL1P/s-l225/Apple-MacBook-Air-2020-13-3-inch-1-1GHz-i5-8GB-RAM.jpg)
Apple MacBook Air (2020) 13.3-inch, 1.1GHz, i5, 8GB RAM, 512GB SSD, Space Gray
$419.00
![16GB DDR4 Corsair Vengeance LPX 3000 Mhz 1.35V Desktop Computer PC Memory RAM picture](/store/img/g/et0AAOSwiyBlc1dP/s-l225/16GB-DDR4-Corsair-Vengeance-LPX-3000-Mhz-1-35V-Des.jpg)
16GB DDR4 Corsair Vengeance LPX 3000 Mhz 1.35V Desktop Computer PC Memory RAM
$30.89