What is Flux Framework?

The Flux framework is a family of projects used to build site-customized resource management systems for High Performance Computing (HPC) data centers.

Flux framework projects are in early development and are not suitable for production workloads.

Current projects include:

  • flux-core - implements the communication layer and lowest level services and interfaces for the Flux resource manager framework. It consists of a distributed message broker and plug-in comms modules that implement various distributed services.

  • flux-sched - contains the job scheduling facility for the Flux resource manager framework. It consists of an engine that handles all the functionality common to scheduling. The engine has the ability to load one or more scheduling plugins that provide specific scheduling behavior.

  • capacitor - implements a bulk execution manager using flux-core. Capacitor provides functionality like that of job arrays or tools like CRAM, except with the full capabilities of flux and its job scheduling facilities like flux-sched. If you need to run and monitor thousands of jobs in an allocation, and don’t want an email from your sysadmins, consider flux and capacitor.