Big Cloud Week Coming Up
Next week is shaping up to be a big week for cloud computing (again).
| Sun | Mon | Tue | Wed | Thu | Fri | Sat |
|---|---|---|---|---|---|---|
| 1 | ||||||
| 2 | 3 | 4 | 5 | 6 | 7 | 8 |
| 9 | 10 | 11 | 12 | 13 | 14 | 15 |
| 16 | 17 | 18 | 19 | 20 | 21 | 22 |
| 23 | 24 | 25 | 26 | 27 | 28 | 29 |
| 30 |
Next week is shaping up to be a big week for cloud computing (again).
Shay Hassidim, deputy CTO at GigaSpaces, posted an impressive write-up of a benchmark the team ran on Amazon EC2. What's nice about it is that they took a standard web app, in this case the Spring PetClinic, and dropped it into the GigaSpaces container, achieving instant low-latency and scalability, with out-of-the-box load-balancing and fail-over. Extremely cool.
The other components in the app include standard and open source components: Jetty, MySQL, Apache load-balancer, JMeter and Ant.
Also, Shay posts a screen shot (I think it's the first-ever public one) of the new GigaSpaces cloud framework. Check it out:
See the full benchmark numbers on Shay's post. And you can sign up for a GigaSpaces pay-per-use EC2 license here.
Last week we made a very exciting announcement about Miwok Airways selecting GigaSpaces as the application server for running their reservation and pricing engine which will run on EC2. This is a great case study for cloud computing.
For one thing, you have to love the fact that it is cloud computing used for a business that literally runs in the clouds (the actual meteorological kind). Second, it is an on-demand compute infrastructure for a business that has an on-demand business model in the real world. A perfect fit.
There is a great piece in the LA Times that describes Miwok, but let me give you a brief description from the software application angle.
The idea is that for so-called ultra-short flights (typically, less than 250 miles), as a traveler you have a terrible dilemma: use commercial airlines or drive your car. I don't need to tell you the hassle and costs involved in both options these days.
Miwok overcomes the hassles of these options by providing you with an on-demand "air taxi" service. You book your flight when you need it. So, say, you want to fly from Santa Monica to Orange County or Palm Springs. You go to the Miwok web site and say when and where, you get pricing and you can book the flight on the spot. The flight you are booking is for a private Cirrus SR22. You can park 100 feet from the airplane itself (at a local airport, not just the major ones) and you don't need to go through security (imagine that!). All of this at the same cost of a commercial flight.
But here's the part I really like:You can connect to other people via Miwok's own social network, or through a Facebook app (and others to come). As the Cirrus can seat 3 passengers, you can split the costs with other passengers who need to make the same trip. So the flight could end up significantly cheaper than a commercial airline.
Think about it: This is the exact opposite pricing model of big airliners, where the more people go on a flight, the price goes up. From a marketing point of view, this has tremendous viral potential.
One of the biggest technology (technology as in software, not aviation) challenges Miwok was facing was developing an extremely sophisticated real-time pricing engine. It needs to take many parameters into account to offer you a price on the spot, including location, path, season, date, time of booking, number of passengers and several other criteria. It needs to be able to grow and shrink on-demand, especially because of the social networking and viral effect.
The architecture Miwok selected uses MySQL and Hibernate for the persistence layer, but the database is not used as the system of record for calculation and reservations. Instead they use GigaSpaces' in-memory data grid, which gives you in-memory speeds and can also grow and shrink dynamically in the EC2 environment. The benefit for Miwok is that having very little advance knowledge on the traffic they will get, and expecting extreme peaks and troughs in activity, they don't need to pre-plan and invest upfront in the infrastructure. They use GigaSpaces and EC2 and will only pay for hardware and software on a per-use basis -- when and if they actually need it.
They also use GigaSpaces XAP (which includes the in-memory data grid) as the container for the business logic, written in Java, and as a bus for integrating the various underlying services involved in generating pricing and booking reservations.
In short, on-demand application scalability for an on-demand air travel service.
Check out Miwok's web site.
Sign up for the GigaSpaces pay-per-use license for Amazon EC2.
As Dekel has already written on his blog, we are releasing our cloud framework for private beta. This was intended as a very "soft launch" sent to about 30 customers and partners already using GigaSpaces on public clouds (such as EC2, GoGrid, Joyent and Flexiscale) to help us test it out and provide feedback on how we can improve it.
On-Demand Enterprise just published a piece I wrote about some of the lessons learned from the current financial crisis and cloud computing. Although there is of course no direct connection, there are some interesting conclusions.
Although I'm not suggesting that it was the crux of the current crisis, one of the questions that has come up recently is why Wall Street's massive investments in value-at-risk analysis system did not curb the downfall. We have not heard (at least not yet) that these risk analyses were blinking with red lights and were ignored. In an HPCwire piece entitled "The Quantitative Models Tanked Too," editor Michael Feldman tackles this issue. Although not the only explanation, one of the issues raised in the article is the fact that the models used were over-simplified. Feldman explains that "in some cases, limits in computational power made these simplifications necessary so that the valuation models could be run."
Done right, cloud computing offers nearly limitless computing power. Had they used a cloud service such as EC2, and software that is built to scale on the cloud, the quants on Wall Street could have easy, cheap and on-demand access to massive computation power.
Kent Lagley writes on the Joyent blog about the work he has done with Dekel and Owen running GugaSpaces on the Joyet Accelerators. It's a well-written detailed blog and in a post entitled Cloud Computing with Java, Kent adds some more info on his personal blog, ProductionScale.
Some other exciting things about this exercise in the lab was that it was, in general, easy. We added and removed nodes, scaled linearly, pulled nodes out, re-deployed the application in seconds to minutes, we processed large amounts of data, and we did all this in the cloud with really minimal efforts.
The announcement by Oracle this week that they are "on the cloud" was once again quite an amusing piece of public relations. I don't know if Oracle is serious when they make these announcements or if they are secretly smiling to themselves.
Another interesting comparison is revealed by this amusing press release from Oracle about a start-up customer named Qtrax. Look at the stack Oracle managed to sell them to build their application. I put in brackets the price per CPU for each Oracle product from the official price list, and I quote:
"Qtrax's implementation includes Oracle Database [$17.5k to $47.5k], Oracle Real Application Clusters [$23k], Oracle Enterprise Manager [$3.5 to $20k+] and components of Oracle Fusion Middleware [?], including Oracle Application Server [$10k to $30k] and Oracle Coherence [$4k to $25k]. With this software now in place, Qtrax will have the ability to support millions of concurrent users [they better!]."
On top of these numbers (which total in the range of $58k to $145.5k per CPU1)add a 22% annual support fee. As these are perpetual licenses, let's break the license numbers to an hourly rate by assuming 24/7 for 3 years: we get $2.20 to $5.54. Even if you decide to be generous and divide by 4 years, you get $1.65 to $4.15. Now, let's not forget that Oracle doesn't actually offer any special pricing for it's products on EC2 (i.e., an hourly rate)2 so you would have to buy the licenses upfront, as Qtrax apparently did.
This is a long overdue acknowledgment of my friend and colleague at GigaSpaces, Dekel Tankel's blog - Thoughts from the Clouds. A lot of people out there are talking about cloud computing, without truly understanding the issues, and without real-world experience -- and so we need more blogs such as Dekel's.
A couple of weeks ago John Willis recorded a podcast with me as part of his excellent Cloud Cafe podcast series. He just posted it online and you can listen to it here.
Toon Vanagt at Virtualization.com recorded a video interview with me at Structure 08 in San Francisco (I spoke on a panel). I talk about cloud computing and GigaSpaces, virtual middleware, the economics of pay-per-use pricing and more. Here it is: