error in modeling_openmoe.py
#3
by
xiaojia1086
- opened
from colossalai.moe.layers import SparseML
while
ModuleNotFoundError: No module named 'colossalai.moe.layers
and i didnt find "SparseMLP" in colossalai
Hi Xiaojia, thanks for the report! I believe this error stems from a recent change in the ColossalAI repository. Could you please try creating a virtual environment and installing an archived version of ColossalAI instead? Feel free to ping me if the error persists.
You might also find the Colab Demo helpful :)
https://colab.research.google.com/drive/1TbFT7ACuHbb7o2WAJn_KKmfvUzN9Z_Xs?authuser=1