31 2 21

lmdeploy

unsubscribe

https://github.com/InternLM/lmdeploy

AI & ML interests

None yet

Recent Activity

updated a model 2 days ago

internlm/Intern-S1-GGUF

updated a model 3 days ago

internlm/internlm3-8b-instruct-gguf

new activity 11 days ago

Qwen/Qwen2-VL-7B-Instruct-GPTQ-Int8:how to create the gptq model using GPTQModel package?

View all activity

Organizations

New activity in Qwen/Qwen2-VL-7B-Instruct-GPTQ-Int8 11 days ago

how to create the gptq model using GPTQModel package?

#4 opened 11 days ago by

unsubscribe

New activity in Qwen/Qwen3-30B-A3B-GPTQ-Int4 11 days ago

how to create the quantized model from auto-gptq

#3 opened 11 days ago by

unsubscribe

New activity in internlm/internlm3-8b-instruct-gptq-int4 6 months ago

update metadata

#1 opened 6 months ago by

lvhan

New activity in internlm/internlm2_5-7b-chat-gguf about 1 year ago

Tool calls broken; Link to fix

#2 opened about 1 year ago by

apresence

New activity in internlm/internlm2_5-7b-chat about 1 year ago

chat prompt

#6 opened about 1 year ago by

apepkuss79

New activity in internlm/internlm-xcomposer2d5-7b about 1 year ago

lmdeploy usage

#4 opened about 1 year ago by

jzchai-exwzd

New activity in internlm/internlm2_5-7b-chat-gguf about 1 year ago

[UNUSEDTOKEN145]

#1 opened about 1 year ago by

MoonRide

New activity in internlm/internlm2_5-7b-chat-1m about 1 year ago

1M inference error on A100 80GBx4 System

#1 opened about 1 year ago by

shi3z

New activity in internlm/internlm2-chat-20b-4bits over 1 year ago

Update config.json

#4 opened over 1 year ago by

BridgeEight

New activity in internlm/internlm2-math-7b over 1 year ago

Apply for community grant: Academic project (gpu)

#1 opened over 1 year ago by

InternLM-Math

New activity in internlm/InternLM2-Chat-20B-TurboMind-4Bits over 1 year ago

Unable to trigger a next round of discussion

#2 opened over 1 year ago by

xianbao

Apply for community grant: Academic project (gpu)

#1 opened over 1 year ago by

unsubscribe

New activity in internlm/internlm2-chat-20b-4bits over 1 year ago

Update special tokens

#1 opened over 1 year ago by

unsubscribe

New activity in internlm/internlm2-chat-7b-4bits over 1 year ago

Update special tokens

#1 opened over 1 year ago by

unsubscribe

New activity in lmdeploy/llama2-chat-70b-4bit over 1 year ago

llama2-chat-70b-w4 weights

👍 1

#1 opened almost 2 years ago by

sandrobovelli

New activity in internlm/internlm-chat-20b-4bit almost 2 years ago

Update modeling_internlm.py

#11 opened almost 2 years ago by

irexyc

python3: No module named lmdeploy.serve.turbomind.main;

#1 opened almost 2 years ago by

victorx98

[Bug] win11下gpu：4090使用docker部署internlm-chat-20b-4bit，显示WARNING: Can not find tokenizer.json. It may take long time to initialize the tokenizer.提问时无反馈卡死。

#3 opened almost 2 years ago by

appleatiger

推理报错 [TM][ERROR] CUDA runtime error: invalid argument

#5 opened almost 2 years ago by

kkkknddnjfks

Assertion Error

😔 1

#6 opened almost 2 years ago by

BBLL3456

lmdeploy

AI & ML interests

Recent Activity

Organizations

unsubscribe's activity

how to create the gptq model using GPTQModel package?

how to create the quantized model from auto-gptq

update metadata

Tool calls broken; Link to fix

chat prompt

lmdeploy usage

[UNUSEDTOKEN145]

1M inference error on A100 80GBx4 System

Update config.json

Apply for community grant: Academic project (gpu)

Unable to trigger a next round of discussion

Apply for community grant: Academic project (gpu)

Update special tokens

Update special tokens

llama2-chat-70b-w4 weights

Update modeling_internlm.py

python3: No module named lmdeploy.serve.turbomind.__main__;

[Bug] win11下gpu：4090使用docker部署internlm-chat-20b-4bit，显示WARNING: Can not find tokenizer.json. It may take long time to initialize the tokenizer.提问时无反馈卡死。

推理报错 [TM][ERROR] CUDA runtime error: invalid argument

Assertion Error

python3: No module named lmdeploy.serve.turbomind.main;