Does your Hadoop cluster need a cluster manager? It just might. Let’s see why.
Every day we hear about more organizations implementing Hadoop as part of their IT infrastructure. Most people think of Hadoop installation as something that starts on top of an existing, working cluster. But how did that cluster get there? And once everything is up and running somebody has to keep the thing up and running in order to keeping getting value out of it.
Whether it’s force of habit, or from actual need, users of HPC environments crave interactivity. Because the impact of unmanaged interactive sessions can be significant, there exists the potential for concern. Is it possible to meet users’ need for interactivity while managing the potential for impact? In this first part of a two-part series on managing interactive impact, attention focuses on the introduction of login nodes to a cluster managed by Bright Cluster Manager. The second part in this series will focus on use of workload managers as a complementary means for managing the interactive impact on the compute nodes of a cluster.
The Bright Cluster Manager installer allows you to customize the disk partition layout on the head node as well as the compute nodes. While the layout of compute nodes can be changed after installation, the head node partitioning layout cannot. So it's important to think about how you want to partition the disks on the head node before installation. The Bright installer provides a built-in editor you can use to customize the disk layout. But you can also do this outside of the Bright installer. This article describes how to edit the master disk layout outside of the Bright installer.
