Version 72 (modified by ibaldin, 8 years ago)

--

Deploying an Authority (Aggregate Manager/AM)

Overview

An ORCA Authority actor runs on behalf of an infrastructure provider (e.g., a cloud site) and exports its resources through ORCA. This section covers deployment steps for a typical ORCA site authority (AM) running a Eucalyptus cloud site. The setup presumes that the container with ORCA is deployed on the head node of the Eucalyptus cluster (although this is not a firm requirement).

The configuration of an ORCA site authority for Eucalyptus consists of the following steps:

  • Set up a Eucalyptus cluster
  • Set up Image Proxy
  • Optionally setup ssh DNAT Proxy. This component is needed only if the cloud site has no publicly routable IP addresses to assign to VMs.
  • Create an ORCA configuration directory ($ORCA_HOME) and populate it with configuration files describing the cloud site and selected policies.
  • Download and customize Tomcat servlet engine (container)
  • Deploy ORCA into Tomcat container

Deploying a Eucalyptus/NEuca authority

Deployment Overview

Here are some suggestions for possible Eucalyptus cluster hardware configurations.

  • The ORCA container is typically set up on the Eucalyptus head node. It can be set up on any host with a route to the Eucalyptus head node.
  • Image Proxy is typically set up on the Eucalyptus head node. It can be set up on any host with a route to the Eucalyptus head node. Eucalyptus user tools (euca2ools) must be installed on this host.
  • ssh DNAT proxy must be set up on a host with a publicly routable IP address and a route to the Eucalyptus head node

For example in the simplest case, when a Eucalyptus head node has a publicly routable IP address and a pool of public IP addresses to give out to VMs, the ssh DNAT Proxy is not needed and the ORCA container and Image Proxy can be installed on the Eucalyptus head node.

For creating slice dataplane (Layer 2 network connecting nodes within a slice) within a cluster, ORCA can use one of the following approaches:

  • The cluster has a network switch that ORCA is empowered to create VLANs on (currently we support Juniper EX3200, Cisco 65xx and 34xx families)
  • The cluster is given a pool of VLANs by the network administrator

Setup Eucalyptus

We have modified Eucalyptus to be more friendly to network experimenters. Follow instructions for setting up Eucalyptus with NEuca patches at Eucalyptus 2.x setup with NEuca.

There are instructions on how to use NEuca with ORCA, which we will be referring to throughout this document, so it is useful to read through it.

Additional components

We have developed several components that make a Eucalyptus site more ORCA- and GENI- friendly. These components are:

  • Image Proxy - downloads and caches shared VM images from the network using HTTP/FTP/bittorrent, and registers them for use within the Eucalyptus site. The Image Proxy allows ORCA users to reference images from virtual appliance servers or distribute custom VM images for use at multiple cloud sites.
  • DNAT Proxy - permits public SSH access to VMs/slivers even when they do not have public IP addresses (e.g., for a Eucalyptus cluster that is hosted behind a firewall).

Image Proxy is a mandatory component, while DNAT proxy is optional. Both components are set up separately and configured for use by ORCA through the $ORCA_HOME/ec2/ec2.site.properties file. The following sections describe how to set up these components. Be sure to match the right versions of components to your ORCA release.

Image Proxy

When a user requests a VM from a cloud infrastructure service, it must specify a filesystem image, kernel (optional) and ramdisk (optional) for the VM. The Image Proxy allows ORCA users to name these objects with URLs, and deploy images at multiple cloud sites easily, without manual registration. Swarming protocols such as BitTorrent? can be used to distribute images to many sites efficiently. Follow instructions on https://code.renci.org/gf/project/networkedclouds/wiki/?pagename=ImageProxy to set up and run Image proxy. To configure ORCA to use the Image proxy, follow instructions on ImageProxy with ORCA.

Image Proxy is typically deployed into a separate Axis2 container on the Eucalyptus master host. If not, it can be deployed on a separate host that

  • Has a routable path to Eucalyptus head node
  • Has Eucalyptus user tools installed

Image Proxy with Eucalyptus/NEuca

ssh DNAT Proxy Tunneling and Using Shorewall

When you need management access to VM instances created in a private address space separated from the public Internet, ssh proxy tunneling can be used. We support Shorewall-DNAT proxy for this purpose. Install and run Shorewall on a machine (the NAT host) that is accessible via the public Internet by following instructions at Shorewall setup. To use Shorewall with ORCA, follow instructions for Shorewall configuration for ORCA.

The DNAT Proxy must be installed on a host that has a publicly routable IP address and has a route to the Eucalyptus head node. DNAT Proxy is only needed if the Eucalyptus head node has no publicly routable IP address or has no public IP addresses to give out to the VMs.

DNAT Proxy

Note that the DNAT proxy is intended only for management access to VMs in a slice. Dataplane communications are separate and do not require proxying.

ORCA Configuration

As described at the top of this section, you should select a host to run a container with ORCA authority actor(s). All configuration actions are then limited to this host.

Create a MySQL database for ORCA

Follow these instructions.

Prepare $ORCA_HOME directory

Follow instructions on how to set up ORCA configuration directory structure, generate one GUID for the new container and two GUIDs and certificates for new actors (make note of actor GUIDs).

Be sure to enable remote actor registry in container.properties file.

After that create additional directories for storing Eucalyptus site properties and credentials (ec2.site.properties, ec2.cred.properties files) and Euca site resource description files (in NDL-OWL):

$ mkdir $ORCA_HOME/ndl
$ mkdir $ORCA_HOME/ec2

Eucalyptus credentials

Create user 'orca' or similar in your Eucalyptus cluster portal. Go to the portal and download the users credentials zip file. Unzip the contents euca credentials zip file into $ORCA_HOME/ec2.

$ cd $ORCA_HOME/ec2
$ unzip ~/euca2-orca-x509.zip 

Comment out the first line in $ORCA_HOME/ec2/eucarc (ORCA uses native EC2 tools to talk to Eucalyptus, rather then eucalyptus user tools; the first line confuses EC2 tools):

#EUCA_KEY_DIR=$(dirname $(readlink -f ${BASH_SOURCE}))

Generate a key-pair for Euca for the Eucalyptus 'orca' user created above. The name of this keypair is used later to populate the "ec2.ssh.key" property in ec2.site.properties file below.

$ source $$ORCA_HOME/ec2/eucarc
$ euca-add-keypair orca
$ cat <output_previous_command> > $$ORCA_HOME/ec2/orca

Generate and store resource representations for the Eucalyptus Site

Generate the NDL resource description of the Eucalyptus site and store it in $ORCA_HOME/ndl. Example of an Eucalyptus site NDL resource description can be found here. Consult RENCI staff on how to generate this. Let ORCA_SRC be the root of the downloaded ORCA source. Actor config.xml file will reference this file later.

$ cp $ORCA_SRC/network/src/main/resources/orca/network/rencivmsite.rdf $ORCA_HOME/ndl/.
$ cp $ORCA_SRC/network/src/main/resources/orca/network/renciNet.rdf $ORCA_HOME/ndl/.

$ORCA_HOME/config/ec2.site.properties

Modify orca/trunk/handlers/ec2/ec2.site.sample.properties for your installation. For the ssh DNAT proxy section, see this document. For the Image proxy section, see "Handler Integration" in this document. Name this file 'ec2.site.properties' and place it in $ORCA_HOME/config .

$ cp $HOME/ec2.site.sample.properties $ORCA_HOME/config/ec2.site.properties 

$ORCA_HOME/config/eucanet.cred.properties

Look up the "Credentials" sub-section of the section "Eucanet handler" to populate eucanet.cred.properties file and place it in $ORCA_HOME/config .

$ORCA_HOME/config/config.xml

An example of a configuration file for a container with site authority actors managing an Eucalyptus/NEuca cluster and a network switch can be found here. Please modify this file to tailor to your installation. At a minimum update the GUIDs (use the GUIDs generated above for each actor), names and descriptions of the two actors. Verify that

  • substrate.file
  • ec2.site.properties
  • ec2.keys
  • eucanet.credentials

have the correct absolute paths in your environment. Name this file 'config.xml' and place it in $ORCA_HOME/config

$ cp $HOME/euca-m.renci.ben-config.xml $ORCA_HOME/config/config.xml 

Note that the example file defines two authority actors for a Euca site - one for VMs and internal VLANs (renci-vm-site) and one for external VLANs (renci-net-site). If your site's dataplane switch does not have access to NLR, ION or another programmable network service, you do not need the *-net-site actor. A *-vm-site can create embedded topologies of VMs within a single Euca cluster without creating connections to the outside world.

Set up Tomcat and deploy the webapp

Download the binary ORCA webapp war file. Follow instructions for setting up Tomcat and deploy a ''binary'' webapp.

Some troubleshooting tips

Attachments