GGUF
conversational
n1ck-guo commited on
Commit
d9a3d51
·
verified ·
1 Parent(s): ba4da35

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +52 -63
README.md CHANGED
@@ -6,7 +6,7 @@ base_model:
6
  ---
7
  ## Model Details
8
 
9
- This gguf model is an int4 model with group_size 32 and symmetric quantization of [moonshotai/Kimi-K2-Instruct](https://huggingface.co/moonshotai/Kimi-K2-Instruct) generated by [intel/auto-round](https://github.com/intel/auto-round) algorithm.
10
 
11
  ## How To Use
12
  ### Requirements
@@ -14,79 +14,68 @@ Please follow the [Build llama.cpp locally](https://github.com/ggerganov/llama.c
14
  ### INT4 Inference
15
  ```bash
16
  >>> text="9.11和9.8哪个数字大"
17
- >>> ./llama-cli -m Kimi-K2-Instruct-BF16-384x14B-Q2_K_S-00001-of-00013.gguf -p $text -n 512 --threads 16 -no-cnv
18
  ## Generated:
19
- ## 要比较 **9.11** 和 **9.8** 的大小,可以将它们转化为小数形式以便比较。
20
- ## 1. **9.11** 已经是小数形式。
21
- ## 2. **9.8** 可以表示为 **9.80**。
22
- ## 现在比较小数点后的数字:
23
- ## - **9.11** 的小数部分是 **0.11**
24
- ## - **9.80** 的小数部分是 **0.80**
25
- ## 因为 **0.80** > **0.11**,所以 **9.8** 大于 **9.11**。
26
- ## 最终答案是:
27
- ## \boxed{9.8} [end of text]
 
 
 
 
 
 
 
 
 
28
 
29
 
30
  >>> text="strawberry中有几个r?"
31
- >>> ./llama-cli -m Kimi-K2-Instruct-BF16-384x14B-Q2_K_S-00001-of-00013.gguf -p $text -n 512 --threads 16 -no-cnv
32
  ## Generated:
33
- ## The word "strawberry" contains two 'r' characters. Here's the breakdown:
34
- ## - **S**
35
- ## - **T**
36
- ## - **R**
37
- ## - **A**
38
- ## - **W**
39
- ## - **B**
40
- ## - **E**
41
- ## - **R**
42
- ## - **R**
43
- ## - **Y**
44
- ## So, there are **2** 'r' in "strawberry". [end of text]
45
 
46
 
47
  >>> text="There is a girl who likes adventure,"
48
- >>> ./llama-cli -m Kimi-K2-Instruct-BF16-384x14B-Q2_K_S-00001-of-00013.gguf -p $text -n 512 --threads 16 -no-cnv
49
  ## Generated:
50
- ## That’s great! Adventures can be thrilling and enriching experiences. Here are a few ideas to inspire her adventurous spirit:
51
- ## ### Outdoor Adventures:
52
- ## 1. **Hiking**: Explore national parks or local trails to connect with nature.
53
- ## 2. **Camping**: Spend a night under the stars or in a forest.
54
- ## 3. **Rock Climbing**: Challenge yourself with cliffs or indoor climbing walls.
55
- ## 4. **Kayaking or Canoeing**: Explore rivers, lakes, or even the ocean.
56
- ## ### Travel Adventures:
57
- ## 5. **Backpacking**: Travel to new countries or regions with minimal luggage.
58
- ## 6. **Road Trips**: Explore nearby towns or cities by driving or biking.
59
- ## 7. **Volunteering Abroad**: Combine adventure with helping others in foreign countries.
60
- ##
61
- ## ### Thrilling Activities:
62
- ## 8. **Skydiving**: Experience the thrill of free-falling.
63
- ## 9. **Scuba Diving**: Discover underwater worlds and marine life.
64
- ## 10. **Zip-lining**: Feel the rush of flying through the air.
65
- ##
66
- ## ### Creative Adventures:
67
- ## 11. **Urban Exploration**: Discover hidden gems in your city or town.
68
- ## 12. **Photography Expeditions**: Capture unique landscapes or cultures.
69
- ## 13. **Learning Something New**: Try a hobby like surfing, pottery, or archery.
70
- ##
71
- ## ### Nature Adventures:
72
- ## 14. **Wildlife Safaris**: Observe animals in their natural habitats.
73
- ## 15. **Forest Bathing**: Immerse yourself in nature for relaxation and mindfulness.
74
- ## 16. **Gardening**: Explore growing your own plants or creating a garden.
75
- ##
76
- ## ### Cultural Adventures:
77
- ## 17. **Festivals**: Attend cultural events to learn about traditions.
78
- ## 18. **Historical Sites**: Visit museums, ruins, or ancient landmarks.
79
- ## 19. **Language Learning**: Learn a new language and immerse yourself in its culture.
80
- ##
81
- ## No matter the adventure, it’s important to stay safe, prepared, and open-minded. Adventure is about exploring, learning, and embracing the unknown! 🌟 [end of text]
82
-
83
-
84
- >>> text="Please give a brief introduction of DeepSeek company."
85
- >>> ./llama-cli -m Kimi-K2-Instruct-BF16-384x14B-Q2_K_S-00001-of-00013.gguf -p $text -n 512 --threads 16 -no-cnv
86
  ## Generated:
87
- ## DeepSeek is a Chinese company specializing in artificial intelligence (AI) technologies and applications. Founded in 2023, DeepSeek focuses on developing advanced AI solutions for various industries, including finance, healthcare, education, and entertainment. The company emphasizes innovation in natural language processing (NLP), machine learning, and data analytics to create intelligent systems that enhance decision-making and efficiency. DeepSeek aims to bridge the gap between cutting-edge AI research and practical applications, contributing to technological advancements and digital transformation across sectors. [end of text]
88
- ```
89
 
 
90
  ### Generate the model
91
 
92
  **tuning**
 
6
  ---
7
  ## Model Details
8
 
9
+ This gguf model is an int2 model with group_size 32 and symmetric quantization of [moonshotai/Kimi-K2-Instruct](https://huggingface.co/moonshotai/Kimi-K2-Instruct) generated by [intel/auto-round](https://github.com/intel/auto-round) algorithm.
10
 
11
  ## How To Use
12
  ### Requirements
 
14
  ### INT4 Inference
15
  ```bash
16
  >>> text="9.11和9.8哪个数字大"
17
+ >>> ./llama-cli -m Kimi-K2-Instruct-BF16-384x14B-Q2_K_S-00001-of-00013.gguf -p You are Kimi, an AI assistant created by Moonshot AI.$text -n 512 --threads 16 -no-cnv
18
  ## Generated:
19
+ ### 思考过程:
20
+ 1. **理解问题**:题目问的是“9.11和9.8哪个数字大”,即比较两个小数的大小。
21
+ 2. **明确数字**:9.11和9.8都是十进制小数,可以拆分为整数部分和小数部分。
22
+ - 9.11:整数部分是9,小数部分是0.11。
23
+ - 9.8:整数部分是9,小数部分是0.8。
24
+ 3. **比较整数部分**:两个数的整数部分都是9,因此无法通过整数部分直接判断大小,需要比较小数部分。
25
+ 4. **比较小数部分**:
26
+ - 小数部分分别是0.11和0.8。
27
+ - 可以统一位数进行比较:0.11是11/100,0.8是80/100。
28
+ - 比较11和80,显然80 > 11。
29
+ 5. **结论**:小数部分0.8 > 0.11,因此9.8 > 9.11。
30
+
31
+ ### 关键概念:
32
+ - 小数比较时,先比较整数部分,整数部分相同时再比较小数部分。
33
+ - 小数部分可以补零对齐位数(如0.8可视为0.80),方便比较。
34
+
35
+ ### 最终答案:9.8
36
+
37
 
38
 
39
  >>> text="strawberry中有几个r?"
40
+ >>> ./llama-cli -m Kimi-K2-Instruct-BF16-384x14B-Q2_K_S-00001-of-00013.gguf -p You are Kimi, an AI assistant created by Moonshot AI.$text -n 512 --threads 16 -no-cnv
41
  ## Generated:
42
+ ### Thought Process:
43
+
44
+ To determine how many times the letter "r" appears in the word "strawberry," we can break it down step by step:
45
+
46
+ 1. **List each letter in the word**: s, t, r, a, w, b, e, r, r, y.
47
+ 2. **Identify all instances of the letter "r"**:
48
+ - The 3rd letter is "r".
49
+ - The 8th letter is "r".
50
+ - The 9th letter is "r".
51
+ 3. **Count the occurrences**: There are 3 instances of "r" in "strawberry".
52
+
53
+ ### Final Answer: 3
54
 
55
 
56
  >>> text="There is a girl who likes adventure,"
57
+ >>> ./llama-cli -m Kimi-K2-Instruct-BF16-384x14B-Q2_K_S-00001-of-00013.gguf -p You are Kimi, an AI assistant created by Moonshot AI.$text -n 512 --threads 16 -no-cnv
58
  ## Generated:
59
+ …and her name is Kimi.
60
+
61
+ She packs a small red backpack with a flashlight, a folded map, and a pocket-sized notebook. Every Saturday she picks a new spot on the map—sometimes a forest trail, sometimes an abandoned lighthouse, sometimes just a crooked alley she’s never walked. She goes alone, because solitude makes the colors sharper and the stories clearer.
62
+
63
+ When she reaches the place, she opens her notebook and writes three things:
64
+ 1. What the wind smells like.
65
+ 2. The first sound she hears that no one else has noticed.
66
+ 3. One question she still can’t answer.
67
+
68
+ She does this because adventure isn’t only about where you go; it’s about how the place rearranges the inside of your head. After she’s filled a page, she stands still, eyes closed, and counts to thirty. By the time she opens them, the world always looks a little different—brighter, riskier, kinder.
69
+
70
+ Then she walks home, already planning next Saturday’s tiny, enormous voyage.
71
+
72
+
73
+ >>> text="Please give a brief introduction of Moonshot AI."
74
+ >>> ./llama-cli -m Kimi-K2-Instruct-BF16-384x14B-Q2_K_S-00001-of-00013.gguf -p You are Kimi, an AI assistant created by Moonshot AI.$text -n 512 --threads 16 -no-cnv
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
75
  ## Generated:
76
+ Moonshot AI is a Chinese artificial intelligence company founded in 2023, focusing on developing large language models and related technologies. The company's flagship product is Kimi, a smart assistant and AI chatbot powered by its self-developed large language model. Moonshot AI aims to advance Chinese-language AI capabilities and provide users with intelligent, efficient, and friendly interaction experiences.
 
77
 
78
+ ```
79
  ### Generate the model
80
 
81
  **tuning**