In 2013, the Hadoop market was $2.0 billion. By 2020, it will be $50.2 billion. According to a recent article from Cloud Times, Allied Market Research's report reveals the global market for Hadoop is expected to grow 58 percent annually from 2013 to 2020.
Last week, Bright Computing Senior Systems Architect Robert Stober presented a session entitled Why your Hadoop cluster needs a cluster manager at the 2014 Hadoop Summit.
His talk covered some of the many benefits that using an enterprise-grade cluster manager can bring to the world of Hadoop. From automated health checks to node provisioning at the push of a button, there’s a lot to gain by using the right tool for the job.
As promised, we're posting Robert's deck here for those who were unable to watch the session. We hope you find it helpful.
Evaluating cluster management solutions can be a daunting task. Fortunately, others have blazed a trail and documented their findings to help you out.
The folks at The Swiss Supercomputing Centre (CSCS) did some work that could help you do your own cluster manager evaluation. They were interested in finding a cluster manager that handled the accelerators and coprocessors that are so important in today's high performance clusters, and shared their findings in this report.
The CSCS evaluation team was free to focus their attention on hybrid architecture support because they were building on work done by Intel that established 20 evaluation criteria to consider when choosing a cluster manager.
If you're considering a cluster management solution for your organization, you may want to read up on the Intel approach we told you about last month, and the CSCS report, applying their research to your own needs.