How to export data from Bright: Taking a look at Prometheus exporter


By Martijn de Vries | April 24, 2020 | Bright Cluster Manager, Prometheus Exporter



Even though Bright Cluster Manager provides a fantastic monitoring environment for high performance computing, AI, data science, big data, OpenStack, machine and deep learning environments, it’s important to recognize that a Bright cluster is not an island in an organization's IT infrastructure. Many organizations will have infrastructure-wide monitoring and reporting environments in place, in addition to Bright’s capabilities. We also have to accept that there may be companies that wish to use monitoring tools other than Bright View to see monitoring data.

Therefore, Bright Cluster Manager needs to be able to report data to other monitoring solutions in order to integrate into the organization’s larger IT environment seamlessly. To accommodate these requirements, Bright's cmdaemon on the head node can be enabled to act as a Prometheus data exporter.

Prometheus is an open-source monitoring and alerting toolkit for containers and microservices. Based on the organizations that have adopted it, Prometheus has become the mainstream, open-source monitoring tool of choice for those that lean heavily on containers and microservices.

When Bright’s cmdaemon acts as a Prometheus data exporter, it allows the infrastructure-wide Prometheus server to grab monitoring data off the Bright cluster. This means that Bright monitoring data can be pulled into the Prometheus monitoring solution for a more holistic view of the organization’s IT environment.

In the same way, Bright Cluster Manager is also able to interconnect with Grafana, an open-source platform for data visualization, monitoring, and analysis. Grafana allows users to create dashboards with panels, each representing specific metrics over a set time frame.

So, if you want your Bright cluster to report into a Prometheus datacenter-wide infrastructure for monitoring, we can provide a Prometheus API endpoint, and you can point utilities to it that are used to dealing with Prometheus, such as Grafana. This will allow you to visualize Bright monitoring data, using Grafana.

This has been a common request from our customers, so we are excited to share details about how easy a problem it is to solve. Many organizations need to have a monitoring solution that is standardized across all IT equipment, and who want to be able to pull data into the standardized platform from Bright, and that is now possible.

To ask any questions about our Prometheus exporter, please contact us.