June 07, 2021 — Posted by Penporn Koanantakool and Pankaj Kanwar. As the number of accelerators (G

PluggableDevice: Device Plugins for TensorFlow — The TensorFlow Blog

submited by

Style Pass

2021-06-07 17:00:11

June 07, 2021 — Posted by Penporn Koanantakool and Pankaj Kanwar. As the number of accelerators (GPUs, TPUs) in the ML ecosystem has exploded, there has been a strong need for seamless integration of new accelerators with TensorFlow. In this post, we introduce the PluggableDevice architecture which offers a plugin mechanism for registering devices with TensorFlow without the need to make changes in TensorFlow co…

As the number of accelerators (GPUs, TPUs) in the ML ecosystem has exploded, there has been a strong need for seamless integration of new accelerators with TensorFlow. In this post, we introduce the PluggableDevice architecture which offers a plugin mechanism for registering devices with TensorFlow without the need to make changes in TensorFlow code.

This PluggableDevice architecture has been designed & developed collaboratively within the TensorFlow community. It leverages the work done for Modular TensorFlow, and is built using the StreamExecutor C API. The PluggableDevice mechanism is available in TF 2.5.