The ScaleIO Framework for Apache Mesos was released in October 2016 and generated lots of buzz integrating container schedulers with software-based storage platforms, furthering capabilities of the Mesos platform. The ScaleIO Framework’s innovative approach was the first of its kind to treat ScaleIO as a natural extension of the Container Scheduler. This had the effect of transforming the storage platform into a simple service provided by the scheduler. Ultimately, this enables containers to request external storage resources from the scheduler easily and transparently as if that task were requesting a local compute resources like memory or CPU.

With this third release, we are implementing a new feature that will allow the resources amongst compute nodes to be explicitly provisioned for ScaleIO based on a predetermined specification or plan. This is accomplished by leveraging Mesos Agent attributes to carve up resources and imprint the configuration that is desired.

The new feature in ScaleIO Framework v0.3…

  • Allows a seasoned ScaleIO user the freedom and flexibility to map out a configuration without getting into the nitty-gritty details of installing RPMs or DEBs but still take advantage of one’s experience to get the fine grained control of a thought-out deployment. Think of this as an *advanced* deployment option.
  • Enables integration with configuration management tools. The deployment for your Mesos cluster may already be using your favorite DevOps tool like Puppet; however, your existing DevOps process can be augmented to define Mesos Agent attributes so you can turn over the procedural steps to ScaleIO deployment to the Framework.
  • Becomes the interface to interact and since this is a Mesos Framework, its interface is a simple, stable and well-known. The interface insulates users from any ScaleIO changes in packaging, APIs, etc.

The next step is heading towards the Universe… the Mesosphere Universe that is. Plans are underway to publish this in the Mesosphere repo to make ScaleIO available for all DC/OS users via their catalog of apps. In fact, there is a branch on my fork with this work in progress that can be viewed here. We are looking to get a pull request in real soon.

Check out the video at the end to see the ScaleIO Framework in action. Interested in more? Give it a try in the {code} labs and provide feedback! You can find more information on the ScaleIO Framework’s GitHub page with specific details how the ScaleIO Framework utilizes Mesos attributes and how to launch this Framework on Mesos.