DN:

ORCA Master: go-m1: 192.168.201.11

ORCA VM Inventory go-1: 192.168.201.12 go-2: 192.168.201.14 go-3: 192.168.201.15 go-4: 192.168.201.16

ORCA Storage: go-s1: 192.168.201.20

Installation Notes

* KVM

  • Master: double hit PrtScr
  • Rack: 6
  • Port mapping
    • 1: go-m1
    • 2: go-1
    • 3: go-2
    • 4: go-3
    • 5: go-build
    • 6: go-nfs
    • 16: BEN GW:

* PXE install CENTOS

  • Software RAID and partition on 'go-m1' (2x 500G HD)
    • softraid: /boot,/LVM VG
    • LVM group (VGos) -> LV(/,/home,/opt,/var)
  • Software RAID and partition on 'go-1' (2x 80G HD)
    • soft RAID: /boot,/swap,/LVM
    • LVM group (VGos) -> LV(/,/home,/opt,/var)
  • Partition on 'go-1,2,3,4) (1x80G HD)
    • Partition: / (5G),/swap (2G),/LVM (70G)

* Network config:

  • /etc/sysconfig/network-scripts/ (static IP)
    • ifcfg-eth0 (172.x),ifcfg-eth1(192.168.201.x)
  • /etc/sysconfig/network
    • HOSTNAME=go-1.renci.ben
  • Go to DNS (https://gw.ben.renci.org:10000/) to change the DN and reload the zone file.

* OPENVPN to BEN GW (gw.ben.renci.org)

  • Create an LDAP account (ldap.ben.renci.org)
  • Ask Ilia for your credential package including cert and key
  • Use OPENVPN client
  • Mac users can use Tunnelblick (opensource)

* LDAP authentication:

  • Install libnss_ldap if not existing.
  • Copy following files to /etc:
    • ldap.conf nsswitch.conf resolv.conf
    • renci_ca.pem sudoers
    • /etc/pam.d/common.* (Ubuntu); /etc/pam.d/system-auth (CentOs)

ORCA Installation

* Tools

  • /home/orca
  • ./environment
    • export ANT_HOME=/home/orca/software/apache-ant-1.7.1/
    • export MV2_HOME=/home/orca/software/apache-maven-2.1.0-M1/
    • export MV2_REPO=/home/orca/.m2/repository
    • export JAVA_HOME=/usr/lib/jvm/jre-sun
    • export JRE_HOME=$JAVA_HOME
    • export PATH=$JAVA_HOME/bin:$MV2_HOME/bin:$ANT_HOME/bin:$PATH
    • export ORCA_USER=/home/orca
    • export ORCA_HOME=/home/orca/svn/orca/core/trunk
    • export CATALINA_HOME=ORCA_USER/tomcat
    • export ORCA_DB_USER=orca
    • export ORCA_DB_USER_PASSWORD=
    • export ORCA_DB_NAME=orca
    • export HOST=localhost
    • export ORCA_DB_SERVER=localhost
    • export ORCA_WEB=$ORCA_USER/svn/orca/webapp/trunk
  • Sun JAVA 1.5.0_15
  • Ant 1.7.1
  • Maven 2.1.0-M1
  • maven-ant-tasks-2.0.9.jar into $ANT_HOME/lib
  • yum install mysql_server
    • mysql -u root
    • mysql> grant all privileges on orca.* to 'orca'@'localhost' identified by ;
    • mysql> quit
    • mysql -u orca
    • mysql> create database orca;
    • mysql> quit
    • mysql -u orca -p -h localhost < $ORCA_HOME/schema/mysql/full.schema.sql
    • mysql -u orca -p -h localhost < $ORCA_HOME/schema/mysql/full.data.sql

* Deploying ORCA

  • $ORCA_USER/tomcat: start.sh, stop.sh
    • CATALINA_HOME=ORCA_USER/tomcat
  • webapp/
    • ant copy.local
    • local/config.xml (default: config/config.xml
      • describes an instance of Orca with three actors: 1 service manager, 1 broker, and 1 authority. All three actors run in the context of a local container
      • Line 53:
        • <!-- Physical machines to be transferred to this site -->
        • <property name="inventory.machines" value="go-1 go-2 go-3" />
        • <!-- Resource pool configuration -->
        • <property name="resource.pools.count" value="1" />
        • <!-- First resource pool configuration -->
        • <property name="resource.pool.0" value="1" />
        • <property name="resource.pool.name.0" value="Renci" />
        • <property name="resource.pool.type.0" value="1" />
        • <property name="resource.pool.properties.0" value="memory=2048,cpu=100,bandwidth=1000" />
        • <property name="resource.pool.machines.0" value="go-1 go-2 go-3 go-4" />
        • <!-- Source ticket configuration -->
        • <property name="resource.pool.ticket.units.0" value="4" />
      • Line 80:
        • <property name="network.base" value="192.168.201.0" />
        • <property name="network.mask" value="255.255.225.0" />
        • <property name="network.subnet" value="255.255.255.0" />
        • <property name="network.min" value="10" />
        • <property name="network.gateway" value="192.168.201.254" />
      • Line 93:
        • <property name="dns.zone" value="renci.ben" />
        • <property name="dns.mx" value="10 renci.ben" />
      • Line 203: <units>4</units>
    • LVM handler (orca/handlers/standard/)
      • Each handler is an Ant XML build file with three targets: setup, modify, and teardown. creates the VM and its root disk image and binds resources to it.
      • /home/orca/svn/orca/handlers/standard/trunk/resources/handlers/standard/xen/lvm
      • mvn deploy
    • cd $ORCA_WEB
      • cp -r $ORCA_HOME/tools/cmdline/runtime .
      • mvn clean; mvn package
      • cp target/orca.war $CATALINA_HOME/webapps/
  • cmdline
    • cd $ORCA_USER/tools/cmdline
    • mvn install
    • ant GUID (generate the guid for all the machines by repeating this)
  • http://go-m1.renci.ben:8080/orca
  • mysql inventory:
    • mysql -u orca -p
    • USE orca;
    • INSERT INTO Machines(mch_id,mch_name, mch_host_name, mch_nid, mch_ip, mch_ram, mch_available,mch_mt_id,mch_act_id,shirakoproperties) VALUES (1,'go-1','go-1', '5e130fde-e556-4db2-acc6-20a3539d6ad7', '192.168.201.12',2048, 1,1,3,'shirako'), (2,'go-2','go-2', '6dccb7fc-4c2d-4911-b0cf-451a123f7d43', '192.168.201.14',2048, 2,2,3,'shirako'), (3,'go-3','go-3', 'cb7af6d2-85e8-4d27-b3fd-5c6a8a77b8f0', '192.168.201.15',2048, 3,3,3,'shirako'), (4,'go-4','go-4', 'f9d13c72-92e2-492c-8669-c353a75f8999', '192.168.201.16',2048, 4,4,3,'shirako');
  • Note: The entries are different from the ORCA guide. act_id(1-server, 2-broker, 3-site)

Handlers and Nodeagent installation configuration customization for the inventory machines

  • $ORCA_USER/tools/config/trunk/user.properties
    • # SSH private key for administrative operations
    • ssh.key=/home/orca/.ssh/id_dsa
    • domain=.duke.ben
    • machines=go-1 go-2
    • # Administrative user
    • ssh.user=root
  • $ORCA_USER/handlers/standard/trunk/resources/handlers/standard/xen/zfs/user.properties
    • # Name of the kernel file
    • unit.os.kernel=vmlinuz-2.6.18-nfsroot
    • # Default image guid
    • image.guid=b24aa725-f142-4c19-8e22-998bbf483f6a
    • ssh key to use to determine when the vm has finished booting
    • vm.ssh.key=orca_rsa

Note

Correct ant-maven repository dependency with:

mvn install:install-file -DgroupId=ant -DartifactId=ant-maven -Dversion=2.0.7 -Dpackaging=jar -Dfile=/home/orca/svn/orca/nodeagent/trunk/codetmp/ant/ant-maven/2.0.7/ant-maven-2.0.7.jar