tavihalperin naomiKenKorem commited on
Commit
d7a5791
·
verified ·
1 Parent(s): f70e2a3

upload model card (#4)

Browse files

- upload model card (eadb961d612c0136beca06812e55ef4d8531c419)


Co-authored-by: ken korem <[email protected]>

.gitattributes CHANGED
@@ -33,3 +33,4 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ samples/sample_0.gif filter=lfs diff=lfs merge=lfs -text
LTX-Video-ICLoRA-canny-13b-0.9.7.txt ADDED
@@ -0,0 +1,2 @@
 
 
 
1
+ LTX-Video-ICLoRA-canny-13b-0.9.7 (�LTXV�)
2
+
README.md ADDED
@@ -0,0 +1,59 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ tags:
3
+ - ltx-video
4
+ - image-to-video
5
+ pinned: true
6
+ language:
7
+ - en
8
+ license: other
9
+ pipeline_tag: text-to-video
10
+ library_name: diffusers
11
+ ---
12
+
13
+ # LTX Video ICLoRA Canny 13B 0.9.7
14
+
15
+ This is a canny control model on top of [`LTXV_13B_097_DEV`](https://huggingface.co/Lightricks/LTX-Video/blob/main/ltxv-13b-0.9.7-dev.safetensors) trained on custom data.
16
+
17
+ ## What is In-Context LoRA (IC LoRA)?
18
+
19
+ IC LoRA is a method that enables adding video context into the video generation process. This approach allows for video-to-video control on top of the text-to-video model, providing more precise control over the generated content by conditioning the model on reference video frames during inference.
20
+
21
+ comfy compatible model: [ltxv-097-ic-lora-canny-control-comfyui.safetensors](https://huggingface.co/Lightricks/LTX-Video-ICLoRA-canny-13b-0.9.7/blob/main/ltxv-097-ic-lora-canny-control-comfyui.safetensors)
22
+
23
+
24
+ diffusers compatible model:[ltxv-097-ic-lora-canny-control-diffusers.safetensors](https://huggingface.co/Lightricks/LTX-Video-ICLoRA-canny-13b-0.9.7/blob/main/ltxv-097-ic-lora-canny-control-diffusers.safetensors)
25
+
26
+ ## License
27
+
28
+ For licensing information, please refer to the [LTXV Open Weights License](LTX-Video-ICLoRA-canny-13b-0.9.7.txt).
29
+ ## Model Details
30
+
31
+ - **Base Model:** [`LTXV_13B_097_DEV`](https://huggingface.co/Lightricks/LTX-Video/blob/main/ltxv-13b-0.9.7-dev.safetensors)
32
+ - **Training Type:** IC LoRA training
33
+ - **Learning Rate:** 0.0002
34
+
35
+ ## Sample Outputs
36
+
37
+
38
+ | |
39
+ |:---:|
40
+ | ![example1](./samples/sample_0.gif) |
41
+
42
+ ## Usage
43
+
44
+ This model is designed to be used with the LTXV (Lightricks Text-to-Video) pipeline.
45
+
46
+ ### 🔌 Using Trained LoRAs in ComfyUI
47
+ In order to use the trained lora in comfy:
48
+ 1. Copy the comfyui trained LoRA weights to the `models/loras` folder in your ComfyUI installation.
49
+ 2. Use ic-lora-canny-control.json from [official LTXV ComfyUI repository](https://github.com/Lightricks/ComfyUI-LTXVideo)
50
+
51
+
52
+
53
+
54
+
55
+
56
+ ## Acknowledgments
57
+
58
+ - Base model by [Lightricks](https://huggingface.co/Lightricks)
59
+ - Training infrastructure: [LTX-Video-Trainer](https://github.com/Lightricks/ltx-video-trainer)
samples/sample_0.gif ADDED

Git LFS Details

  • SHA256: a70c182ecf7477a8e291f89559b9ddd6bd1cb87aa41fc286c0d5fa853fbf64d7
  • Pointer size: 133 Bytes
  • Size of remote file: 37.1 MB