Hugging Face's logo

kernels-community
/
megablocks

Kernels
Model card Files
xet
 Community
3
How to use from the
Use from the
Kernels library
# !pip install kernels

from kernels import get_kernel

kernel = get_kernel("kernels-community/megablocks")

This is the repository card of kernels-community/megablocks that has been pushed on the Hub. It was built to be used with the kernels library. This card was automatically generated.

How to use 

# make sure `kernels` is installed: `pip install -U kernels`
from kernels import get_kernel

kernel_module = get_kernel("kernels-community/megablocks")
MyReplacementLayer = kernel_module.MyReplacementLayer

MyReplacementLayer(...)

Available functions

  • MyReplacementLayer
  • exclusive_cumsum
  • inclusive_cumsum
  • histogram
  • indices
  • replicate_forward
  • replicate_backward
  • sort
  • cumsum
  • argsort
  • Arguments
  • ParallelDroplessMLP
  • dMoE
  • SparseGLU
  • MLP
  • SparseMLP
  • MoE
  • ParallelMLP
  • get_load_balancing_loss

Benchmarks

Benchmarking script is available for this kernel. Run kernels benchmark kernels-community/megablocks.

Downloads last month
277
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Space using kernels-community/megablocks 1