Transformers.js v3: WebGPU Support, New Models & Tasks, and More…
Installation WebGPU support Usage in Transformers.js v3 New quantization formats (dtypes) Basic usage Per-module dtypes 120 supported architectures Example projects and templates Over 1200 pre-converted models Node.js (ESM + CJS), Deno, and Bun compatibility A new home on NPM and GitHub After more than a year of development, we're excited to announce the release of 🤗 Transformers.js v3!
WebGPU is a new web standard for accelerated graphics and compute. The API enables web developers to use the underlying system's GPU to carry out high-performance computations directly in the browser. WebGPU is the successor to WebGL and provides significantly better performance, because it allows for more direct interaction with modern GPUs. Lastly, it supports general-purpose GPU computations, which makes it just perfect for machine learning!
As of October 2024, global WebGPU support is around 70% (according to caniuse.com), meaning some users may not be able to use the API.
.png)
