jax.experimental.pallas.mosaic_gpu.semaphore_signal_multicast

jax.experimental.pallas.mosaic_gpu.semaphore_signal_multicast#

jax.experimental.pallas.mosaic_gpu.semaphore_signal_multicast(semaphore, value=1, *, collective_axes)[source]#

Signals a semaphore on all devices along collective_axes.

At the moment only signals to all devices are supported.

Parameters:
  • semaphore – The semaphore reference to signal.

  • value (int | jax.Array) – The increment value for the semaphore.

  • collective_axes (Hashable | tuple[Hashable, ...]) – The mesh axes to multicast the signal across. Must contain all mesh axes.