Piloting the cloud

Last month, Nick wrote about how Orbital is being designed as an application to run in the cloud. This week, we met with Andy Powell from Eduserv to discuss the use of their ‘Education Cloud‘ for the Orbital project.

In the run up to this meeting, we’d been talking to colleagues in ICT Services about our need for more flexibility and autonomy when we required servers in order to do our work. Outside of work we’re quite used to spinning up servers on Rackspace or AWS to try things out and increasingly we’ve been looking for ways to take control of our servers in this way at work. We’re not the only Researchers who need this flexibility; colleagues in LiSC have also been telling us that for some of their work, the scalability and reliability of cloud services is looking increasingly attractive.

This is not to say that ICT services is inflexible and unreliable by any means. I’ve always found my colleagues very willing to help where and when they can, but I think we’d all agree that a central ICT department in a university, with the multivarious responsibilities it has, is not the same as a dedicated cloud provider and, in our case, does not offer the resilience nor the scalability that Rackspace or Amazon are offering for example. The availability of resources, the business model and available support are quite different. When I joined the University in 2007, ICT Services were implementing a new VMWare server farm, which has given us more flexibility than having to work with physical boxes in every instance. Typically, if I want a Linux server with 4GB RAM and 100GB of HDD, I put in a request, transfer approx. £1200, and some time later, a virtual server is provided to me at no further cost. If I need more RAM or HDD, I put in another request, transfer some money, and some time later, I get what I need. This process can take weeks or months.

However, our VMWare farm is now almost five years old and nearing ‘end of life’ and I know that ICT are thinking about the next five year cycle and how cloud computing fits into their future plans. Colleagues in the Online Services team have been using Rackspace recently as a CDN for the Common Web Design framework as well as hosting our popular Gateway website, and have been very impressed with the service. The main hurdle was not technical but organisational: billing for the use of the CDN is by credit card and Pay As You Go (PAYG), meaning we don’t know exactly how much it will cost each month. This is in contrast to how departments normally make payments which are known in advance and invoiced in arrears. Nevertheless, that hurdle has been overcome and hopefully set a precedence.

So the meeting we had with ICT Services was in light of all this and we recognised and agreed that Orbital was a timely and appropriate project by which the university could pilot a more extensive use of cloud services and look at how we might integrate servers in the cloud with our existing server farm. It would also allow us to think about new business models where the real costs of running a server are more transparent to everyone, rather than being absorbed by ICT as the server ages.

Nick has been setting up the Orbital development environment and basic architecture (more on that in another post) using Rackspace and the Orbital project pays for this each month via our departmental credit card. This works fine if a) the department is happy to use the credit card in this way; and b) we have dedicated project funds for this, but it’s no way to run a long-term service that is to be sustained by the institution. Our interest is not really in whether we use Rackspace or Eduserv for hosting during the period of our project – both offer Linux boxes afterall – rather we’re interest in working with ICT to ensure that by the end of the project, there are formal processes in place for a) running sustained services in the cloud; and b) providing researchers with the ability to spin up and manage adhoc servers as and when they are required.

The plan is to evaluate both Rackspace and Eduserv over the coming months, looking at which service fits best with the future plans of ICT Services. Rackspace has a much more mature offering, but we’re really keen to work with Eduserv too, recognising that they’re a new not-for-proft provider of cloud services, running on JANET and with a long history of providing hosting and other technical services to HE and government.

At our meeting with Andy, he went through much the same presentation that Nick and I had seen at the MRD start-up meeting, answering our specific questions along the way. He also demonstrated (for the first time??) the vCloud Director interface for setting up and managing the servers, and this should, in principle, integrate with our existing VSphere system. One of the nice things about the Eduserv offering is that unlike most other cloud providers, they provide the entire vCloud Director application to their customers, including a full API, rather than a cut-down interface. We’ve yet to see how vCloud Director will allow us to create access controls for different types of users, but that’s what the Orbital project will be helping to investigate and I’m pleased that we’re able to work with our ICT department in this way. There are other important questions, too, around data protection and liabilities, and Andy was keen that we review Eduserv’s Terms and Conditions and SLA and feed back our thoughts on it.

This experience will allow me to better understand the business model of the cloud and how to make the business case for developing and running cloud-based services. As Nick previously said, it also allows us to make our costs more transparent, too, so that the actual costs (per Gigabyte and per Gigahertz) of managing research data are clearer to both Researchers and the institution. Having a clearer idea of the costs will help us create a more sustainable service in the long run.

13 Replies to “Piloting the cloud”

  1. Interesting article. I have used Rackspace on several projects over the years and can’t fault them on reliability or service. Although their servers look expensive, you get what you pay for in terms of the SLA and support. I have recently deployed Rackspace managed email and Sharepoint for a university spin-out company and these are excellent too. I’ll have a fiver on them being one of the impending eight. Following this thought, I am really interested to see what the framework terms are, because while no one can doubt the technology, those ‘other important questions’ will be the things these big companies with their turnkey products may find it harder to accommodate.

    The RDM project at University of Hertfordshire has also been looking at cloud provision and we too have looked beyond the usual suspects. We have been working the HRC Computing Consortium on some pilot services for simple Storage mapped to the desktop, Sharepoint for research groups, backup, and mysql database. Judging from your comment re: maturity of offer, our experience has been similar, albeit in the SaaS, rather than IaaS market. I’ll be reporting more on this over at the University of Hertfordshire RDM blog soon.

  2. Delighted to see this work. The UMF programme commissioned the pilot at Eduserv to support precisely this kind of intiative. The Janet Brokerage is actively seeking institutions who need data centre and cloud services and will announce next week a list of 8 major suppliers under a framework agreement who will be able to offer these services across the sector.

    Please contact the brokerage if you have questions or want to check out any of the services becoming available.

  3. Any ideas Joss as where other institutiosn are headed with this? are we on a similar path to everyone else?just reviewed a reserach grant that was asking for £10k for two servers in their own lab …

    1. Yes, I think we’re with everyone else at this early stage. I think that the Janet brokerage is being seen as the eventual, one-stop-shop for institutions wanting to make large purchases of cloud infrastructure. £10K for two boxes seems steep, but it depends on what they are. If they’re after high performance kit, then that’s probably about right. Whether it can be done cheaper in the cloud depends on how long they intend to use them and what resources they’ll be using at any one time. The cloud is expensive if you’re constantly running large servers over a period of months.

      Happy to look at the grant proposal with you on this matter, if you like.

      p.s. I’ve been in touch with Ben from LiSC who should be given access to our Eduserv trial any day now.

    2. cheers Joss – the server stuff was a minor part of the proposal I looked at – I just thought it a bit odd they’d be asking for them but maybe its more sesnible than i thought!

Comments are closed.