"The cloud" - on-demand distributed computing power

Andrew Walkingshaw's picture

Simulation scientists are mostly limited by both the number, and the speed, of the computers available to them. Really large simulations need really serious computer resources, but simulations like that are pretty rare; so the resources for them have been concentrated in regional grids or national centres like the UK's HPCx.

Economically this makes a lot of sense, but there's a lot of overhead; for instance, compute time has to be bid for long in advance of when it might actually be used. In that light, commodity on-demand computing services like Amazon's EC2 begin to look promising as an alternative; they have even greater economies of scale than the national infrastructure services, can provide a scientist with more CPU power at essentially no notice, and often provide more flexibility in choice of operating system and software than a centrally-provided system can. At the moment, they don't scale to the massively parallel calculations that the national supercomputers specialize in, but sooner or later they'll be competitive even for those cases.

Tags:

Average: 3 (1 vote)

Comments

Jerry Sheehan's picture

Drivers for Virtualization?

Andrew:

What do you think the majors drivers for virtualization will be? Do you think it will be a) cost, b) performance, c) environmental impact?

Jerry Sheehan
phone: 858.336.2622
yahoo: calit2s
skype: zenchaos
twitter: www.twitter.com/zenchaos

Andrew Walkingshaw's picture

Economic drivers

Bit of all of the above - the power requirements are a compelling green argument (don't know if you've seen the suggestion, but people have the idea that the UK should move its datacentres to the Shetland Isles and turn them into, more or less, gigantic windfarms), but the big driver I see is cost/flexibility. At the moment, researchers, if they've got money, have to build (or use) some compromise grid rather than having the architecture which is best suited to the problem they're facing - and they have to find uses for it the whole time or have it sit idle. That's no use, really; what you want is to be able to get the resources you need as and when you need them. (To put it nerdily - you want to avoid premature optimization! It's the same story as just-in-time supply in manufacturing.)

So it's about having the most appropriate performance for the best cost at the least impact, and the only way to do that, I reckon, is economies of scale at a larger scale than the research group, university, or even the national research council. Hence the cloud...

Jerry Sheehan's picture

Getting Beyond the Bottom Line and Down To the Culture?

Andrew:

From a cost standpoint cloud computing and storage makes great business sense. However, this type of fiscal argument would have also supported the creation of large common machine rooms at most universities which didn't happen. Instead, individual researchers created their own small clusters and data storage because the "ownership" of the hardware and the ability to physically manipulate the machines was viewed as being key to their science.

What do you think will need to happen culturally to change this? Or, will a disruptive technology, such as ubiquitous high speed networks, get around this without social engineering?

Jerry Sheehan
Manager for Government Program Development @ Calit2/UCSD
phone: 858.336.2622
yahoo: calit2s
skype: zenchaos
twitter: www.twitter.com/zenchaos

Hypotheses that reference this signal:

This signal has no hypotheses. Add a hypothesis

Forecasts that reference this signal:

This signal has no forecasts. Add a forecast