Update README.md
Browse files
README.md
CHANGED
|
@@ -6,7 +6,7 @@ base_model:
|
|
| 6 |
---
|
| 7 |
## Model Details
|
| 8 |
|
| 9 |
-
This gguf model is an
|
| 10 |
|
| 11 |
## How To Use
|
| 12 |
### Requirements
|
|
@@ -14,79 +14,68 @@ Please follow the [Build llama.cpp locally](https://github.com/ggerganov/llama.c
|
|
| 14 |
### INT4 Inference
|
| 15 |
```bash
|
| 16 |
>>> text="9.11和9.8哪个数字大"
|
| 17 |
-
>>> ./llama-cli -m Kimi-K2-Instruct-BF16-384x14B-Q2_K_S-00001-of-00013.gguf -p
|
| 18 |
## Generated:
|
| 19 |
-
|
| 20 |
-
|
| 21 |
-
|
| 22 |
-
|
| 23 |
-
|
| 24 |
-
|
| 25 |
-
|
| 26 |
-
|
| 27 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 28 |
|
| 29 |
|
| 30 |
>>> text="strawberry中有几个r?"
|
| 31 |
-
>>> ./llama-cli -m Kimi-K2-Instruct-BF16-384x14B-Q2_K_S-00001-of-00013.gguf -p
|
| 32 |
## Generated:
|
| 33 |
-
|
| 34 |
-
|
| 35 |
-
|
| 36 |
-
|
| 37 |
-
|
| 38 |
-
|
| 39 |
-
|
| 40 |
-
|
| 41 |
-
|
| 42 |
-
|
| 43 |
-
|
| 44 |
-
|
| 45 |
|
| 46 |
|
| 47 |
>>> text="There is a girl who likes adventure,"
|
| 48 |
-
>>> ./llama-cli -m Kimi-K2-Instruct-BF16-384x14B-Q2_K_S-00001-of-00013.gguf -p
|
| 49 |
## Generated:
|
| 50 |
-
|
| 51 |
-
|
| 52 |
-
|
| 53 |
-
|
| 54 |
-
|
| 55 |
-
|
| 56 |
-
|
| 57 |
-
|
| 58 |
-
|
| 59 |
-
|
| 60 |
-
|
| 61 |
-
|
| 62 |
-
|
| 63 |
-
|
| 64 |
-
|
| 65 |
-
|
| 66 |
-
## ### Creative Adventures:
|
| 67 |
-
## 11. **Urban Exploration**: Discover hidden gems in your city or town.
|
| 68 |
-
## 12. **Photography Expeditions**: Capture unique landscapes or cultures.
|
| 69 |
-
## 13. **Learning Something New**: Try a hobby like surfing, pottery, or archery.
|
| 70 |
-
##
|
| 71 |
-
## ### Nature Adventures:
|
| 72 |
-
## 14. **Wildlife Safaris**: Observe animals in their natural habitats.
|
| 73 |
-
## 15. **Forest Bathing**: Immerse yourself in nature for relaxation and mindfulness.
|
| 74 |
-
## 16. **Gardening**: Explore growing your own plants or creating a garden.
|
| 75 |
-
##
|
| 76 |
-
## ### Cultural Adventures:
|
| 77 |
-
## 17. **Festivals**: Attend cultural events to learn about traditions.
|
| 78 |
-
## 18. **Historical Sites**: Visit museums, ruins, or ancient landmarks.
|
| 79 |
-
## 19. **Language Learning**: Learn a new language and immerse yourself in its culture.
|
| 80 |
-
##
|
| 81 |
-
## No matter the adventure, it’s important to stay safe, prepared, and open-minded. Adventure is about exploring, learning, and embracing the unknown! 🌟 [end of text]
|
| 82 |
-
|
| 83 |
-
|
| 84 |
-
>>> text="Please give a brief introduction of DeepSeek company."
|
| 85 |
-
>>> ./llama-cli -m Kimi-K2-Instruct-BF16-384x14B-Q2_K_S-00001-of-00013.gguf -p $text -n 512 --threads 16 -no-cnv
|
| 86 |
## Generated:
|
| 87 |
-
|
| 88 |
-
```
|
| 89 |
|
|
|
|
| 90 |
### Generate the model
|
| 91 |
|
| 92 |
**tuning**
|
|
|
|
| 6 |
---
|
| 7 |
## Model Details
|
| 8 |
|
| 9 |
+
This gguf model is an int2 model with group_size 32 and symmetric quantization of [moonshotai/Kimi-K2-Instruct](https://huggingface.co/moonshotai/Kimi-K2-Instruct) generated by [intel/auto-round](https://github.com/intel/auto-round) algorithm.
|
| 10 |
|
| 11 |
## How To Use
|
| 12 |
### Requirements
|
|
|
|
| 14 |
### INT4 Inference
|
| 15 |
```bash
|
| 16 |
>>> text="9.11和9.8哪个数字大"
|
| 17 |
+
>>> ./llama-cli -m Kimi-K2-Instruct-BF16-384x14B-Q2_K_S-00001-of-00013.gguf -p You are Kimi, an AI assistant created by Moonshot AI.$text -n 512 --threads 16 -no-cnv
|
| 18 |
## Generated:
|
| 19 |
+
### 思考过程:
|
| 20 |
+
1. **理解问题**:题目问的是“9.11和9.8哪个数字大”,即比较两个小数的大小。
|
| 21 |
+
2. **明确数字**:9.11和9.8都是十进制小数,可以拆分为整数部分和小数部分。
|
| 22 |
+
- 9.11:整数部分是9,小数部分是0.11。
|
| 23 |
+
- 9.8:整数部分是9,小数部分是0.8。
|
| 24 |
+
3. **比较整数部分**:两个数的整数部分都是9,因此无法通过整数部分直接判断大小,需要比较小数部分。
|
| 25 |
+
4. **比较小数部分**:
|
| 26 |
+
- 小数部分分别是0.11和0.8。
|
| 27 |
+
- 可以统一位数进行比较:0.11是11/100,0.8是80/100。
|
| 28 |
+
- 比较11和80,显然80 > 11。
|
| 29 |
+
5. **结论**:小数部分0.8 > 0.11,因此9.8 > 9.11。
|
| 30 |
+
|
| 31 |
+
### 关键概念:
|
| 32 |
+
- 小数比较时,先比较整数部分,整数部分相同时再比较小数部分。
|
| 33 |
+
- 小数部分可以补零对齐位数(如0.8可视为0.80),方便比较。
|
| 34 |
+
|
| 35 |
+
### 最终答案:9.8
|
| 36 |
+
|
| 37 |
|
| 38 |
|
| 39 |
>>> text="strawberry中有几个r?"
|
| 40 |
+
>>> ./llama-cli -m Kimi-K2-Instruct-BF16-384x14B-Q2_K_S-00001-of-00013.gguf -p You are Kimi, an AI assistant created by Moonshot AI.$text -n 512 --threads 16 -no-cnv
|
| 41 |
## Generated:
|
| 42 |
+
### Thought Process:
|
| 43 |
+
|
| 44 |
+
To determine how many times the letter "r" appears in the word "strawberry," we can break it down step by step:
|
| 45 |
+
|
| 46 |
+
1. **List each letter in the word**: s, t, r, a, w, b, e, r, r, y.
|
| 47 |
+
2. **Identify all instances of the letter "r"**:
|
| 48 |
+
- The 3rd letter is "r".
|
| 49 |
+
- The 8th letter is "r".
|
| 50 |
+
- The 9th letter is "r".
|
| 51 |
+
3. **Count the occurrences**: There are 3 instances of "r" in "strawberry".
|
| 52 |
+
|
| 53 |
+
### Final Answer: 3
|
| 54 |
|
| 55 |
|
| 56 |
>>> text="There is a girl who likes adventure,"
|
| 57 |
+
>>> ./llama-cli -m Kimi-K2-Instruct-BF16-384x14B-Q2_K_S-00001-of-00013.gguf -p You are Kimi, an AI assistant created by Moonshot AI.$text -n 512 --threads 16 -no-cnv
|
| 58 |
## Generated:
|
| 59 |
+
…and her name is Kimi.
|
| 60 |
+
|
| 61 |
+
She packs a small red backpack with a flashlight, a folded map, and a pocket-sized notebook. Every Saturday she picks a new spot on the map—sometimes a forest trail, sometimes an abandoned lighthouse, sometimes just a crooked alley she’s never walked. She goes alone, because solitude makes the colors sharper and the stories clearer.
|
| 62 |
+
|
| 63 |
+
When she reaches the place, she opens her notebook and writes three things:
|
| 64 |
+
1. What the wind smells like.
|
| 65 |
+
2. The first sound she hears that no one else has noticed.
|
| 66 |
+
3. One question she still can’t answer.
|
| 67 |
+
|
| 68 |
+
She does this because adventure isn’t only about where you go; it’s about how the place rearranges the inside of your head. After she’s filled a page, she stands still, eyes closed, and counts to thirty. By the time she opens them, the world always looks a little different—brighter, riskier, kinder.
|
| 69 |
+
|
| 70 |
+
Then she walks home, already planning next Saturday’s tiny, enormous voyage.
|
| 71 |
+
|
| 72 |
+
|
| 73 |
+
>>> text="Please give a brief introduction of Moonshot AI."
|
| 74 |
+
>>> ./llama-cli -m Kimi-K2-Instruct-BF16-384x14B-Q2_K_S-00001-of-00013.gguf -p You are Kimi, an AI assistant created by Moonshot AI.$text -n 512 --threads 16 -no-cnv
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 75 |
## Generated:
|
| 76 |
+
Moonshot AI is a Chinese artificial intelligence company founded in 2023, focusing on developing large language models and related technologies. The company's flagship product is Kimi, a smart assistant and AI chatbot powered by its self-developed large language model. Moonshot AI aims to advance Chinese-language AI capabilities and provide users with intelligent, efficient, and friendly interaction experiences.
|
|
|
|
| 77 |
|
| 78 |
+
```
|
| 79 |
### Generate the model
|
| 80 |
|
| 81 |
**tuning**
|