BonFIRE logo and link to main BonFIRE site

Table Of Contents

Previous topic

Default Monitoring Metrics

Next topic

An overview of reservation

This Page

Release Notes

The BonFIRE facilities in Release 1, Release 2, Release 3, Release 3.1 and Release 4.0.5 include the following features:

Portal

Features in Release 1

  • The Portal can generate OCCI requests for the user
  • The Portal publishes the resources of the BonFIRE sites
  • The Portal lists the available Instance Types (i.e. categorised resource specifications)
  • The Portal lists the available base VM images (i.e. preconfigured VM images with the Debian Squeeze OS and Zabbix monitoring framework)
  • The Monitoring Aggregator VM can be auto-created for experiments defined on the BonFIRE Portal
  • The Portal tunnels through to the monitoring data webserver

Features in Release 2

  • Greatly improved user experience

Features in Release 3

  • Support for JSON Experiment Descriptor, including builder
  • Support for OVF
  • Display of per-experiment usage statistics
  • Linking of site-status and VM-logging information
  • Support for Virtual Wall background traffic emulation
  • Numerous usability changes

Features in Release 4.0.5

  • The Portal has been revamped to better present user and group experiments and give users control over refresh of the output. It also exploits the new caching mechanism for faster resource listings and better support of large experiments.

Experiment Descriptor

Features in Release 1

  • The user can interact with BonFIRE through the BonFIRE OCCI API
  • The BonFIRE Portal can generate OCCI requests for the user
  • Restfully can generate OCCI requests for the user, and also script the creation and steering of an experiment
  • Elasticity: VMs can trigger VM instance creation and deletion through OCCI calls to the BonFIRE API

Features in Release 2

  • Support for simple, domain-specific, Experiment Descriptors
  • Support for user specifiable, near-end-of-experiment triggers to run scripts to e.g archive data
  • Broker message-queue subscription for the VMs to run scripts

Features in Release 3

  • Support for OVF

  • Extended support for simple, domain-specific, Experiment Descriptor

    • Groups
    • IP dependencies
    • State reporting
    • Contextualisation
    • Better error logging through provided URI
    • Specify target cluster and host
    • Specify Virtual Wall background traffic emulation
    • Custom instance-type

Features in Release 4.0.5

  • The new “aggregator” keyword simplifies initiating monitoring on managed experiments
  • JSON Experiment Descriptor now supports the creation of persistent storage outside an experiment

Monitoring

Features in Release 1

  • BonFIRE VM images come pre-installed with the Zabbix monitoring tool

  • Zabbix collects standard monitoring data (e.g. CPU and memory utilisation) for each BonFIRE VM

  • User-specified, application monitoring data (e.g. webserver hit-count) can be collected for each VM

  • Monitoring metrics can be set:

    when creating a VM, through the OCCI interface on a running VM, using standard Zabbix procedures

  • The Monitoring Aggregator VM can be auto-created for experiments defined on the BonFIRE Portal

  • Clients can access the experiment monitoring data through the Zabbix json-rpc API

  • The Portal tunnels through to the experiment’s Zabbix monitoring data webserver

Features in Release 2

  • Extended specification of metric parameters through OCCI
  • Use of separate storage for Aggregator
  • User level infrastructure monitoring
  • Monitoring API available at Broker

Features in Release 3

  • Support for Zabbix Aggregator at iMinds
  • user-specified application monitoring
  • in depth-VM monitoring
  • Timestamp internal processes (not though OCCI)
  • Use Resource Manager-generated, experiment-specific password

Features in Release 4.0.5

  • Experiment Message Queue includes events about user resources, which are generated by the sites to provide more detailed, more accurate information about the resources
  • HLRS, Inria and EPCC expose a new set of infrastructure metrics about energy consumption and the CO2 profile of this energy in the BonFIRE-based STREP ECO2Clouds
  • ECO-metrics together with the new events are available through Zabbix
  • Numerous improvements for stability of Zabbix in our images, including upgrade to version 1.8.16 of Zabbix

Data access

Features in Release 1

  • The user can specify storage resources for the duration of the experiment

    The user must transfer all relevant experiment data out of their BonFIRE VMs prior to experiment expiry

Features in Release 2

  • Distributed storage of persistent data (beyond experiment life)
  • Distributed storage of VM Images

Features in Release 3

  • Support for user quota
  • Support for shared storage on BonFIRE NFS (IBBT)
  • Support for datablocks (and external storage) on Virtual Wall (IBBT)

Network

Features in Release 1

  • Extensive network emulation functionality is avalaible on the BonFIRE Virtual Wall site
  • All BonFIRE sites are connected with each other through best-effort internet
  • VMs on different sites can communicate between them using the BonFIRE VPN.

Features in Release 2

  • Support for Virtual Wall network QoS parameters through OCCI

Features in Release 3

  • VW background traffic emulation (via Emulab)

Features in Release 3.1

  • Support for bandwidth on demand through GEANT AutoBAHN, between EPCC and PSNC

Features in Release 4.0.5

  • Supports VPN access to its resources
  • Easier to use Unix tools for network impairment on all infrastructures
  • The Virtual Wall allows to select the queue strategy
  • Increased number of public IP addresses at EPCC and Inria, along with removal of most of the restrictive firewall rules

Authentication, Authorisation and Accounting

Features in Release 1

  • Access to the Portal and Broker is available through username-password authentication over SSL
  • The user can access their VMs on all BonFIRE sites through SSH with a single set of public-key credentials
  • The BonFIRE Broker uploads SSH credentials to VM
  • Root access is available on all VMs running on the BonFIRE sites

Features in Release 3.1

  • Support for accounting

Experiment Support

Features in Release 2

  • Stopped state between Running and Terminated, to allow users to get data, clean up etc.
  • Consistent contextualisation API for apps to read context
  • Improved OCCI error handling
  • Use of POSTINSTALL to execute a user-specified set-up script

Features in Release 3

  • Groups-based shared access to resources
  • Custom instance type specification
  • Usage statistics
  • Command line tools
  • Rule-based elasticity (pre-configured images and doc)
  • Support for VM deployment on user-specified physical host

Features in Release 3.1

  • Cells and OpenNebula upgrades
  • Improved groups functionality
  • Improved Elasticity as a service (cross-site Elasticity)
  • Interconnection with Amazon EC2
  • Support for Open Access

Features in Release 4.0.5

  • Support for Trial accounts, a much simpler, even faster process to get access to BonFIRE within a working day
  • Improved performance of collection queries via a new Collections Cache component; also mproves site performance via collection data from asynchronous site events
  • Inria and iMinds (be-ibbt) include the new COCOMA image for allowing perform controlled experiments of multi-tenant scenarios (effects of VMs co-located on the same physical machine)
  • COCOMA allows to generate COntrolled, COntentious and MAlicious pattern loads on the physical nodes where it is deployed, affecting resource such as CPU, RAM, disk and network
  • Allows to study in a controlled and repeatable manner how this affects experimenters’ own application

More capacity

Features in Release 4.0.5

  • Wellness Telecom is on line
  • HLRS has more than doubled its capacity to 344 cores
  • EPCC has also all but doubled its capacity to 176 cores
  • Inria upgrades to 96 cores