Hugging Face's logo

numen-tech
/
Qwen2.5-14B-Instruct-GPTQ-Int4

Text Generation
MLC-LLM
English
chat
conversational
4-bit precision
Model card Files
xet
Community
1
numen-tech commited on
Commit
e50b245
·
1 Parent(s): 7e09dd7

Add weights

Browse files
This view is limited to 50 files because it contains too many changes.   See raw diff
Files changed (50) hide show
  1. README.md +11 -0
  2. config.json +5 -0
  3. merges.txt +0 -0
  4. ndarray-cache.json +0 -0
  5. params_shard_0.bin +3 -0
  6. params_shard_1.bin +3 -0
  7. params_shard_10.bin +3 -0
  8. params_shard_100.bin +3 -0
  9. params_shard_101.bin +3 -0
  10. params_shard_102.bin +3 -0
  11. params_shard_103.bin +3 -0
  12. params_shard_104.bin +3 -0
  13. params_shard_105.bin +3 -0
  14. params_shard_106.bin +3 -0
  15. params_shard_107.bin +3 -0
  16. params_shard_108.bin +3 -0
  17. params_shard_109.bin +3 -0
  18. params_shard_11.bin +3 -0
  19. params_shard_110.bin +3 -0
  20. params_shard_111.bin +3 -0
  21. params_shard_112.bin +3 -0
  22. params_shard_113.bin +3 -0
  23. params_shard_114.bin +3 -0
  24. params_shard_115.bin +3 -0
  25. params_shard_116.bin +3 -0
  26. params_shard_117.bin +3 -0
  27. params_shard_118.bin +3 -0
  28. params_shard_119.bin +3 -0
  29. params_shard_12.bin +3 -0
  30. params_shard_120.bin +3 -0
  31. params_shard_121.bin +3 -0
  32. params_shard_122.bin +3 -0
  33. params_shard_123.bin +3 -0
  34. params_shard_124.bin +3 -0
  35. params_shard_125.bin +3 -0
  36. params_shard_126.bin +3 -0
  37. params_shard_127.bin +3 -0
  38. params_shard_128.bin +3 -0
  39. params_shard_129.bin +3 -0
  40. params_shard_13.bin +3 -0
  41. params_shard_130.bin +3 -0
  42. params_shard_131.bin +3 -0
  43. params_shard_132.bin +3 -0
  44. params_shard_133.bin +3 -0
  45. params_shard_134.bin +3 -0
  46. params_shard_135.bin +3 -0
  47. params_shard_136.bin +3 -0
  48. params_shard_137.bin +3 -0
  49. params_shard_138.bin +3 -0
  50. params_shard_139.bin +3 -0
README.md CHANGED
@@ -1,3 +1,14 @@
1
  ---
2
  license: apache-2.0
 
 
 
 
 
 
 
 
 
3
  ---
 
 
 
1
  ---
2
  license: apache-2.0
3
+ license_link: https://huggingface.co/Qwen/Qwen2.5-14B-Instruct-GPTQ-Int4/blob/main/LICENSE
4
+ language:
5
+ - en
6
+ base_model: Qwen/Qwen2.5-14B-Instruct
7
+ base_model_relation: quantized
8
+ library_name: mlc-llm
9
+ pipeline_tag: text-generation
10
+ tags:
11
+ - chat
12
  ---
13
+
14
+ 4-bit [GPTQ](https://arxiv.org/abs/2210.17323) quantized version of [Qwen2.5-14B-Instruct](https://huggingface.co/Qwen/Qwen2.5-14B-Instruct) for use with the [Private LLM app](https://privatellm.app/).
config.json ADDED
@@ -0,0 +1,5 @@
 
 
 
 
 
 
1
+ {
2
+ "quantization_config": {
3
+ "bits": 4
4
+ }
5
+ }
merges.txt ADDED
The diff for this file is too large to render. See raw diff
 
ndarray-cache.json ADDED
The diff for this file is too large to render. See raw diff
 
params_shard_0.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f64caf669b9cc25f64a5023d2420f61fcf0eb7b7d81158f5d1dbf23cacb2a708
3
+ size 389283840
params_shard_1.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f9e5b6b295c6afa5e73fb6e340d3c5ce5dea92c60c7fb8d8f32cd224c15a415d
3
+ size 35389440
params_shard_10.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:12d7b78e87a46d857c953edd27452ed3c6941b3c86c2f459f10a0e04408fcb8d
3
+ size 35389440
params_shard_100.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e38a31672d2f20038f051ac6311fa2e6e14eb962476f4fa3881b515dd71bcb08
3
+ size 32075776
params_shard_101.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:374e3c40dbef3ebec6b501b82ddb842c58b9937b3ed3b2347bba91248a5b94a9
3
+ size 21159936
params_shard_102.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bb13d776fce6a4463dc58959ea9b5277dfef6d8db94bf79b2998b184494caa5a
3
+ size 35389440
params_shard_103.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e638b090bbb44ea11e75b1bf5b437dbc7cc487fe2a430485d38e1e3a434c9f2b
3
+ size 70778880
params_shard_104.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fc7e08dcf8bead1ad16db97b3524c90ae987a206d0a95bea52abaabc324dda05
3
+ size 18350080
params_shard_105.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:95c8c990aabc1731b65f0155f4fd0657e263b940a37865437a4d4c59cae5300b
3
+ size 35389440
params_shard_106.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8c6c6b48d5b3acac9760c309b2bf87000bad3010ef4f68c1a62e833674b1179b
3
+ size 70778880
params_shard_107.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:49deb95c823a818042767200d3553f875755fa7fce4a4b2718660998e4c05473
3
+ size 32075776
params_shard_108.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1173cf9d99b0e79172f64524619aa43d81cf6c9377f3939a30f365fa93e5d595
3
+ size 21159936
params_shard_109.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1b9cbd5ca3ce22f1ec2b712f2cc60922562bc9ce758159cd6a89bbc9f9fa0c7b
3
+ size 35389440
params_shard_11.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:909b7175c462ae4406c10dab84dbc4c7067032367393e7b2ccb073206375122f
3
+ size 70778880
params_shard_110.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8c567ecb20c1bdc3d67a310ead7a2c5396844e224b34638f05de19470b5d13f0
3
+ size 70778880
params_shard_111.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:999f9bd6075f590a4cfa8783465c898213dfb29b0d35c29ca465980cc2f20b53
3
+ size 18350080
params_shard_112.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4e40266f0c16840c3e01c07447fdf40645b9e483a2359d1426777570de8d58c1
3
+ size 35389440
params_shard_113.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:137b56d54a7dfbcbd662169c09590dc9a55b4a3b57ee8e2bfddf5b787706b8e7
3
+ size 70778880
params_shard_114.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:28be8024b124aa8072185a6d9b0c69ba610969c1b3262c681c9d2b9613188529
3
+ size 32075776
params_shard_115.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5b1c4d0b11691fa43d9fa8452627cc9e4664b3316bc5decc423e69d5df1ecf6a
3
+ size 21159936
params_shard_116.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1fca4c865fed0e97f6f4d876f416f47b07691600304803bc04d30c4166d18ced
3
+ size 35389440
params_shard_117.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:173b85fab9f131b161846180f4464dbd2e3dc73961d07b1158258a65a7e29618
3
+ size 70778880
params_shard_118.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c5e87827c97a35a1957a297ee8801641c01e208a44545f7507f359ff85e0a5a7
3
+ size 18350080
params_shard_119.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5b300260b33a67c9efc1a588962179373d803e8dec2295438242205cda9873a2
3
+ size 18350080
params_shard_12.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b877a3a0c99b32235856f8a47efbcc0c333be003dce6532786a4f0c2848aa959
3
+ size 32075776
params_shard_120.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3c87efef1cb667c91698491ee4903d417e54a3c322c31724b934ffca1e51ea8a
3
+ size 31567872
params_shard_121.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:440f8a059be1ea6f39c75d349d375b9e2b7e485545d31ef5505a839b35c041fe
3
+ size 35389440
params_shard_122.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:45aff0a6bd0b4d66c35767551992e0d57699a590718aef0a69ad337193d0fce8
3
+ size 70778880
params_shard_123.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d64a87c7e95539594aba29dde1f55722d4a80127c3a897adf9170d391685052f
3
+ size 35389440
params_shard_124.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a6a381e155aca9079d7effaf4bf8f4cc2673b1ddc6876f13a2e8045ddf7b32a5
3
+ size 70778880
params_shard_125.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3e18e8a4d4d79307667ceda069dcd98c13c4cc39659045b6031f76b0e6dee0e8
3
+ size 18350080
params_shard_126.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0e715e5a334d95fd644a755c30e75509a2e9726915dc292aa27d22f9476f6b5f
3
+ size 20760576
params_shard_127.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:98f6970fbe684d938176eccd89de6fa83ad29bcd9e08d5cbdba885b656265e46
3
+ size 35389440
params_shard_128.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f5105a5ab01af386bcb395fb4e31944e51523ed3235585248502f09fef76d912
3
+ size 70778880
params_shard_129.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:075108fea5b7d6dc1f026453a8d15cd7b8e213f391df55750ba6f72a11a429e4
3
+ size 18350080
params_shard_13.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:672001e42f85d3e81f3fa08098f43f2f314e5e57a13bb4ef6793aead5a8ac566
3
+ size 21159936
params_shard_130.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7c81e5bf33f52d9d902040900535ef0fd72a9869ab2a8e673d7f57f3fc6e18a6
3
+ size 35389440
params_shard_131.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9337372e8508bfc0f5f3f5286f3186ed1f17941d1e8eff6fb20c59b83caef66a
3
+ size 70778880
params_shard_132.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e65bf58f5098e40284cc446b987541b46c9454e9429d356346ba5a236022e5c9
3
+ size 32075776
params_shard_133.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:825ed06e7d770d9ceb624447040b5386d639bcaac4d48402434dfb4002032faf
3
+ size 21159936
params_shard_134.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:46eec10d988896b75008671b08abba4287c1f97acff4131873fa34ffd9c37713
3
+ size 35389440
params_shard_135.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:964f1ed8b1bf8ebc4b6a24f4367190a25db7338f568e74f4fead491081fc9a86
3
+ size 70778880
params_shard_136.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:aa4fcd3dc18a761566202c352014f18483f05db8b2fb6084308958d41c268bb3
3
+ size 18350080
params_shard_137.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9fb6dced21d6d9bdd8498bc2cbb4dabd7f9fe03e2976243c7fa3be9820f33df3
3
+ size 35389440
params_shard_138.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:87d38cf5cff1cebdf1604e5a4e2e9750eeab180608dda1d548b350ca988486da
3
+ size 70778880
params_shard_139.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:51bb757539bff31adf67380ba75bcbfb09d3c1861ab59ee347239c7a670b65af
3
+ size 32075776