Elastic Cloud Computing Cluster: EC3

Hands on EC3

Let's try EC3 with a very simple example, launching a Kubernetes cluster on top of OpenStack. 

1. Create the authentication file

First create a file auth.dat  with a single line like this:

id = ost; type = OpenStack; host = https://host.domain:5000; username = <<user>>; password = <<pass>>; tenant = <tenant>

Replace <<user>> and <<pass>> with the corresponding values for the Openstack account where the cluster will be deployed. Also add the <<tenant>> corresponding value in your case.

This file is the authorization file and can have more than one set of credentials. In fact, we are going to add also a line for the Infrastructure Manager service. Add a line at the end of  auth.dat the the file like this:

id = im; type = InfrastructureManager; username = <your_user>; password = <your_pass>

2. Customize the cluster specification

Now we are going to deploy a cluster in OpenStack with a limit number of nodes = 10. The parameter to indicate the maximum size of the cluster is called ec3_max_instances and it has to be indicated in the RADL file that describes the infrastructure to deploy. In our case, we are going to use the ubuntu-openstack recipe, available in our Github repo. You will need to add some info to this file regarding the name of the Openstack server and the image ID that corresponds to an Ubuntu image in that cloud. Please, edit the 'ubuntu-openstack.radl' file to add it in lines 10 and 17.

3. Deploy the cluster

Once you have the authentication file ready and the ubuntu recipe customized for your site, you can call EC3 CLI to deploy the cluster. The next command deploys a Kubernetes cluster based on an Ubuntu image on top of our Openstack cloud:

$ ec3 launch mycluster kubernetes ubuntu-openstack -a auth.dat -y

Creating infrastructure
Infrastructure successfully created with ID: 60
   ▄▟▙▄¨        Front-end state: running, IP: 132.43.105.28

$ ec3 ssh mycluster
Welcome to Ubuntu 18.04.5 LTS (GNU/Linux 4.15.0-135-generic x86_64)
 * Documentation:  https://help.ubuntu.com/
...
ubuntu@kubeserver:~$

$ ec3 list
   name       state          IP        nodes     provider
------------------------------------------------------------
 mycluster  configured  132.43.105.28    0       OpenStack

Develop your own recipe

network <network_id> (<features>)

system <system_id> (<features>)

configure <configure_id> (<Ansible recipes>)

deploy <system_id> <num> [<cloud_id>]

The keywords network, system and configure assign some features or recipes to an identity <id>. The features are a list of constrains separated by and, and a constrain is formed by <feature name> <operator> <value>. For instance:

system tomcat_node (
   cpu.count = 4 and
   memory.size >= 1024M and
   net_interface.0.connection = 'net'
)

This RADL defines a system with the feature cpu.count equal to four, the feature memory.size greater or equal than 1024M and with the feature net_interface.0.connection bounded to 'net'.

The deploy keyword is a request to deploy a number of virtual machines. Some identity of a cloud provider can be specified to deploy on a particular cloud.

If you want to add your own customized templates to EC3, you need to consider some aspects:

• For image templates, respect the frontend and working nodes nomenclatures. The system section for the frontend must receive the name front, while at least one type of working node must receive the name wn.
• For component templates, add a configure section with the name of the component. You also need to add an include statement to import the configure in the system that you want. See Including a recipe from another for more details.

Also, it is important to provide a description section in each new template, to be considered by the ec3 templates command.