Add IPv6 Support to Condor

Project Name

Add IPv6 Support to Condor

Project Description

Sooner or later we're going to have to live with IPv6. Many applications are very tied to IPv4 and that includes Condor. Understand what IP addresses really mean to Condor, like many existing systems, and what the implications of an IPv6 conversion means and how it can be done. There are many resources about IPv6 interfaces, but not many good transition guides, and fewer that address what the change can really mean to an application - Condor takes addresses and passes them as ascii text between components.

Resource: Nightlife wiki page, Matthew Farrellee

Project Leader(s)

Kezhong Liang

Project Contributor(s)

John Selmys

Project Details

TBA

Project News

Oct 28, 2008:

• Downloaded condor 7.05 source tarball onto Ireland system (running rawhide)
• Unpacked tarball, changed to src directory and ran ./build_init (seemed to run ok)
• Tried to run configure but got error (something dealing with build_external)
  • to fix this I ran ./configure --disable-glibc-version-check but this produced another error - I needed to install csh
• later in the evening Chris installed Fedora 9 so I'll have to start over.

Oct 29, 2008:

• Now that Ireland is running Fedora 9, I did yum install condor - worked ok
  • ran condor_master
  • ran condor_status
  • ran condor_off
  • ran condor_off -master
• Also, on China (running Fedora 8) I downloaded condor 7.05 source tarball.
  • installed csh
  • ran ./build_init
  • ran ./configure --disable-glibc-version-check
  • ran make - got error "asm/page.h no such file

Oct 30, 2008:

• In the Ireland system, Edit and compile a simple "Hello World" c program
• Edit a submit file named hello.sub, submit the file to condor (condor_submit hello.sub)
• Run condor_q to check on the status of my job

Nov 4, 2008:

• Check the submit job on Ireland machine, it hasn't worked.
• On Korea machine(Fedora 9), run yum install condor -- Can't install, remind me lack of gsoap
  • run install gsoap -- Can't install
  • manual download gsoap-2.7.9-0.1.I.i386.rpm, then run rpm -i gsoap-2.7.9-0.1.I.i386.rpm -- OK
  • yum install condor -- OK
• On China machine(Fedora 8), reconfigure using the command "./configure --disable-glibc-version-check --disable-glibc-full-port", then run make it's ok.
• On China machine, create a condor1 virtual machine for Fedora 9, and install condor on virtual machine
  • Solve network problem:
    • 1.Stop firewall
    • 2.Enable ipforward: echo 1 > /proc/sys/net/ipv4/ip_forward
    • 3.run "iptables -t nat -A POSTROUTING -o eth0 -j MASQUERADE"
  • scp 192.168.122.1:DOWNLOAD/*.gz .
  • run yum install csh
  • untar the condor source file
  • ran ./build_init
  • ran ./configure --disable-glibc-version-check ---- ERROR: build_krb5-1.4.3 ERROR: unable to build krb5-1.4.3

Nov 7, 2008:

• Condor First Build

Nov 10, 2008:

• Download condor-7.0.5_1.fc9.src.rpm package from http://rpm.pbone.net on my laptop
• Install Condor
• Configure condor
  • ran condor_configure --install=/usr/etc --type=execute,submit,manager --local-dir=/home/condor
  • Error

Nov 11, 2008:

• Install Fedora 9 32-bit on virtual machine on China and Ireland machine respectively.

Nov 12, 2008:

• Install git package on virtual machine on Ireland system
  • yum install git
• Launch http://git.et.redhat.com/ to find mrg-grid.git, then clone it to local
  • git clone git://git.et.redhat.com/mrg-grid.git

• On Ireland system
  • yum remove condor
  • Download condor-7.0.5_1.fc9.src.rpm package from http://rpm.pbone.net
  • $ rpmdev-setuptree
  • $ cp condor-7.0.5_1.fc9.src.rpm ~/rpmbuild/SOURCES/
  • $ cd ~/rpmbuild/SOURCES/
  • $ rpmbuild --rebuild condor-7.0.5-1.fc9.src.rpm
    • error: Failed build dependencies:
    • pcre-devel is needed by condor-7.0.5-1.fc9.x86_64
    • postgresql-devel is needed by condor-7.0.5-1.fc9.x86_64
    • openssl-devel is needed by condor-7.0.5-1.fc9.x86_64
    • gsoap-devel >= 2.7.10-2 is needed by condor-7.0.5-1.fc9.x86_64
    • classads-devel is needed by condor-7.0.5-1.fc9.x86_64
  • # yum install pcre-devel postgresql-devel openssl-devel gsoap-devel classads-devel
  • $ rpmbuild --rebuild condor-7.0.5-1.fc9.src.rpm
  • # cd /home/kliang10/rpmbuild/RPMS
  • # rpm -i condor-7.0.5-1.fc9.x86_64.rpm
  • # cd /usr
  • # /usr/sbin/condor_configure --install
    • Missing release directories (looking in /usr):
    • sql
    • man
    • Unable to find some release directories.
    • Please specify the correct location of these with
    • --install=<path to release directories> or make sure it's
    • in the current directory
  • # yum install planner
  • # ln -s /usr/share/planner/sql /usr/sql
  • # ln -s /usr/kerberos/man /usr/man
  • # /usr/sbin/condor_configure --install
    • Setting up Condor in /usr
    • cp: cannot stat `/usr/etc/examples/condor_config.generic': No such file or directory
    • Unable to create condor_config file: /usr/etc/condor_config!
  • # ln -s /usr/share/doc/condor-7.0.5/examples /usr/etc/examples
  • # /usr/sbin/condor_configure --install
    • Setting up Condor in /usr
    • WARNING: Multiple network interfaces detected. Condor might not work
    • properly until you set NETWORK_INTERFACE = <interface IP>

• • • WARNING: Unable to contact central manager: localhost.localdomain localhost!

• • • Condor has been installed into:
    • /usr

• • • Configured condor using these configuration files:
    • global: /usr/etc/condor_config
    • local: /usr/local.ireland/condor_config.local

• • # /usr/sbin/condor_configure --install --type=execute,submit,manager --local-dir=/home/condor
    • Setting up Condor in /usr

• • • Condor has been installed into:
    • /usr

• • • In order for Condor to work properly you must set your CONDOR_CONFIG
    • environment variable to point to your Condor configuration file:
    • /usr/etc/condor_config before running Condor commands/daemons.
    • Created scripts which can be sourced by users to setup their
    • Condor environment variables. These are:
    • sh: /usr/condor.sh
    • csh: /usr/condor.csh

• • Startup Condor
    • # /usr/sbin/condor_master

• Submit the first Condor job
  • Write a small program in C, file name is simple.c stored in /home/condor, code is as below
    • #include <stdio.h>

• • • main(int argc, char **argv)
    • {
    • int sleep_time;
    • int input;
    • int failure;

• • • if (argc != 3) {
    • printf("Usage: simple <sleep-time> <integer>\n");
    • failure = 1;
    • } else {
    • sleep_time = atoi(argv[1]);
    • input = atoi(argv[2]);

• • • printf("Thinking really hard for %d seconds...\n", sleep_time);
    • sleep(sleep_time);
    • printf("We calculated: %d\n", input * 2);
    • failure = 0;
    • }
    • return failure;
    • }
  • Compile the simple.c
    • $ gcc -o simple simple.c
  • Create submit file named simple.sub as below
    • Universe = vanilla
    • Executable = simple
    • Arguments = 4 10
    • Log = simple.log
    • Output = simple.out
    • Error = simple.error
    • Queue
  • Submit the job
    • $ condor_submit simple.sub
  • Check the queue
    • $ condor_q

Nov 13, 2008:

• git clone git://git.et.redhat.com/mrg-grid.git

Nov 14, 2008

• Finished the [v0.2 release][1]