This article talks about how one company built a 10000-core compute cluster on AWS cloud for its client.
It’s quite wonderful to see these kind of cloud computing applications being developed at places. For example, here are some important facts to note:
- Cycle Computing boasted that the cluster was roughly equivalent to the 114th fastest supercomputer in the world on the Top 500 list, which hit about 66 teraflops.
- Cycle and Genentech instead opted for a “standard vanilla CentOS” Linux cluster to save money, according to Stowe.
- The 10,000 cores were composed of 1,250 instances with eight cores each, as well as 8.75TB of RAM and 2PB disk space
- Scaling up a couple of thousand cores at a time, it took 45 minutes to provision the whole cluster. There were no problems. “When we requested the 10,000th core, we got it,” Stowe said.
- The cluster ran for eight hours at a cost of $8,500.
- For Genentech, this was cheap and easy compared to the alternative of buying 10,000 cores for its own data center and having them idle away with no work for most of their lives, Corn says.