When it comes to moving tightly coupled high performance computing (HPC) workloads to the cloud, many organizations have been skeptical about its benefits. After all, messaging bottlenecks and scalability challenges have long overshadowed cost and flexibility related benefits of cloud deployments. Some challenges of moving HPC workloads to the cloud that have made organizations slow to migrate in the past have included:
- Slow, high-latency interconnects
- Long job queues
- High virtualization overhead and poor isolation from other workloads
- Data staging challenges and costs (getting large data sets into and out of the cloud)
- Moving from always-on, multi-user batch environments to on-demand cloud resources
- On-prem clusters becoming obsolete or poorly utilized