Uezurii commited on
Commit
7615c80
·
verified ·
1 Parent(s): 90b4148

Deploy CollabHaven AI Enhanced v1.0 - Serverless Ready

Browse files
README.md ADDED
@@ -0,0 +1,116 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ base_model: TinyLlama/TinyLlama-1.1B-Chat-v1.0
4
+ tags:
5
+ - music
6
+ - collaboration
7
+ - ai-assistant
8
+ - collabhaven
9
+ - audius
10
+ - peft
11
+ - lora
12
+ - conversational
13
+ library_name: transformers
14
+ pipeline_tag: text-generation
15
+ ---
16
+
17
+ # CollabHaven AI Enhanced v1.0
18
+
19
+ ## Model Description
20
+
21
+ CollabHaven AI Enhanced is a specialized language model fine-tuned for music collaboration, creative assistance, and community interaction on the CollabHaven platform. Built on TinyLlama-1.1B-Chat with LoRA adapters, this model understands CollabHaven's ecosystem, Audius integration, and provides comprehensive music creation support.
22
+
23
+ ## Key Features
24
+
25
+ 🎵 **Music Creation Assistance**
26
+ - Lyric writing and song structure guidance
27
+ - Chord progression suggestions
28
+ - Melody composition support
29
+ - Beat and rhythm recommendations
30
+ - Mixing and mastering advice
31
+ - Sound design tips
32
+ - Music marketing strategies
33
+ - Artist bio creation
34
+
35
+ 🤝 **CollabHaven Platform Integration**
36
+ - Deep understanding of CollabHaven's collaborative features
37
+ - Audius platform relationship awareness
38
+ - Community guidelines and culture knowledge
39
+ - Project creation and collaboration workflows
40
+ - Real-time collaboration support
41
+
42
+ 🎯 **Specialized Knowledge**
43
+ - CollabHaven official website: https://collabhvn.com
44
+ - Audius profile: https://audius.co/collabhavenr
45
+ - AI Studio tools and capabilities
46
+ - Music industry best practices
47
+ - Creative workflow optimization
48
+
49
+ ## Technical Specifications
50
+
51
+ - **Base Model**: TinyLlama/TinyLlama-1.1B-Chat-v1.0
52
+ - **Fine-tuning Method**: LoRA (Low-Rank Adaptation)
53
+ - **Training Dataset**: 200 enhanced examples (185 general + 15 CollabHaven-specific)
54
+ - **Training Steps**: 150
55
+ - **Max Length**: 512 tokens
56
+ - **Model Size**: ~1.1B parameters + LoRA adapters
57
+
58
+ ## Usage
59
+
60
+ ```python
61
+ from transformers import AutoTokenizer, AutoModelForCausalLM
62
+ from peft import PeftModel
63
+
64
+ # Load the model
65
+ base_model = AutoModelForCausalLM.from_pretrained("TinyLlama/TinyLlama-1.1B-Chat-v1.0")
66
+ model = PeftModel.from_pretrained(base_model, "collabhaven/collabhaven-ai-enhanced")
67
+ tokenizer = AutoTokenizer.from_pretrained("collabhaven/collabhaven-ai-enhanced")
68
+
69
+ # Generate response
70
+ prompt = "What is CollabHaven and how can it help with music collaboration?"
71
+ inputs = tokenizer(prompt, return_tensors="pt")
72
+ outputs = model.generate(**inputs, max_length=200, temperature=0.7)
73
+ response = tokenizer.decode(outputs[0], skip_special_tokens=True)
74
+ print(response)
75
+ ```
76
+
77
+ ## Deployment
78
+
79
+ This model is optimized for serverless deployment and can be easily integrated into:
80
+ - Supabase Edge Functions
81
+ - Vercel Edge Runtime
82
+ - AWS Lambda
83
+ - Azure Functions
84
+ - Google Cloud Functions
85
+
86
+ ## Training Details
87
+
88
+ The model was fine-tuned with comprehensive CollabHaven knowledge including:
89
+ - Platform functionality and features
90
+ - Music creation workflows
91
+ - Community culture and guidelines
92
+ - Audius integration details
93
+ - AI Studio tool capabilities
94
+ - Collaboration best practices
95
+
96
+ ## Performance
97
+
98
+ ✅ **CollabHaven Knowledge**: Comprehensive understanding
99
+ ✅ **Music Creation**: Advanced assistance capabilities
100
+ ✅ **Collaboration**: Expert guidance and workflows
101
+ ✅ **Community**: Culture-aware responses
102
+ ✅ **Technical**: Optimized for production use
103
+
104
+ ## License
105
+
106
+ Apache 2.0
107
+
108
+ ## Contact
109
+
110
+ For questions about CollabHaven AI:
111
+ - Website: https://collabhvn.com
112
+ - Audius: https://audius.co/collabhavenr
113
+
114
+ ---
115
+
116
+ *This model is specifically designed for the CollabHaven music collaboration platform and its community.*
adapter_config.json ADDED
@@ -0,0 +1,36 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "alpha_pattern": {},
3
+ "auto_mapping": null,
4
+ "base_model_name_or_path": "TinyLlama/TinyLlama-1.1B-Chat-v1.0",
5
+ "bias": "none",
6
+ "corda_config": null,
7
+ "eva_config": null,
8
+ "exclude_modules": null,
9
+ "fan_in_fan_out": false,
10
+ "inference_mode": true,
11
+ "init_lora_weights": true,
12
+ "layer_replication": null,
13
+ "layers_pattern": null,
14
+ "layers_to_transform": null,
15
+ "loftq_config": {},
16
+ "lora_alpha": 24,
17
+ "lora_bias": false,
18
+ "lora_dropout": 0.1,
19
+ "megatron_config": null,
20
+ "megatron_core": "megatron.core",
21
+ "modules_to_save": null,
22
+ "peft_type": "LORA",
23
+ "r": 12,
24
+ "rank_pattern": {},
25
+ "revision": null,
26
+ "target_modules": [
27
+ "q_proj",
28
+ "v_proj",
29
+ "k_proj",
30
+ "o_proj"
31
+ ],
32
+ "task_type": "CAUSAL_LM",
33
+ "trainable_token_indices": null,
34
+ "use_dora": false,
35
+ "use_rslora": false
36
+ }
adapter_model.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7c5abda6bd50ba63928da6c88a18d3bc5b5785e86113fddf24e4d134ea68d369
3
+ size 13540184
chat_template.jinja ADDED
@@ -0,0 +1,15 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {% for message in messages %}
2
+ {% if message['role'] == 'user' %}
3
+ {{ '<|user|>
4
+ ' + message['content'] + eos_token }}
5
+ {% elif message['role'] == 'system' %}
6
+ {{ '<|system|>
7
+ ' + message['content'] + eos_token }}
8
+ {% elif message['role'] == 'assistant' %}
9
+ {{ '<|assistant|>
10
+ ' + message['content'] + eos_token }}
11
+ {% endif %}
12
+ {% if loop.last and add_generation_prompt %}
13
+ {{ '<|assistant|>' }}
14
+ {% endif %}
15
+ {% endfor %}
special_tokens_map.json ADDED
@@ -0,0 +1,30 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "bos_token": {
3
+ "content": "<s>",
4
+ "lstrip": false,
5
+ "normalized": false,
6
+ "rstrip": false,
7
+ "single_word": false
8
+ },
9
+ "eos_token": {
10
+ "content": "</s>",
11
+ "lstrip": false,
12
+ "normalized": false,
13
+ "rstrip": false,
14
+ "single_word": false
15
+ },
16
+ "pad_token": {
17
+ "content": "</s>",
18
+ "lstrip": false,
19
+ "normalized": false,
20
+ "rstrip": false,
21
+ "single_word": false
22
+ },
23
+ "unk_token": {
24
+ "content": "<unk>",
25
+ "lstrip": false,
26
+ "normalized": false,
27
+ "rstrip": false,
28
+ "single_word": false
29
+ }
30
+ }
tokenizer.json ADDED
The diff for this file is too large to render. See raw diff
 
tokenizer_config.json ADDED
@@ -0,0 +1,43 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "add_bos_token": true,
3
+ "add_eos_token": false,
4
+ "add_prefix_space": null,
5
+ "added_tokens_decoder": {
6
+ "0": {
7
+ "content": "<unk>",
8
+ "lstrip": false,
9
+ "normalized": false,
10
+ "rstrip": false,
11
+ "single_word": false,
12
+ "special": true
13
+ },
14
+ "1": {
15
+ "content": "<s>",
16
+ "lstrip": false,
17
+ "normalized": false,
18
+ "rstrip": false,
19
+ "single_word": false,
20
+ "special": true
21
+ },
22
+ "2": {
23
+ "content": "</s>",
24
+ "lstrip": false,
25
+ "normalized": false,
26
+ "rstrip": false,
27
+ "single_word": false,
28
+ "special": true
29
+ }
30
+ },
31
+ "bos_token": "<s>",
32
+ "clean_up_tokenization_spaces": false,
33
+ "eos_token": "</s>",
34
+ "extra_special_tokens": {},
35
+ "legacy": false,
36
+ "model_max_length": 2048,
37
+ "pad_token": "</s>",
38
+ "padding_side": "right",
39
+ "sp_model_kwargs": {},
40
+ "tokenizer_class": "LlamaTokenizer",
41
+ "unk_token": "<unk>",
42
+ "use_default_system_prompt": false
43
+ }
training_args.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:68f64f95b655abf5200a0fb149ec99e8b0cf30a53b0efdca20187329e75fb8fd
3
+ size 5713