File size: 7,430 Bytes
27c3832
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
d79e25b
 
27c3832
12a04b2
27c3832
 
12a04b2
 
 
a5cb5d7
12a04b2
 
 
27c3832
 
86ad330
27c3832
 
 
d79e25b
27c3832
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
86ad330
27c3832
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
86ad330
27c3832
 
 
 
cf3ec42
27c3832
 
 
 
 
86ad330
27c3832
 
 
86ad330
27c3832
86ad330
27c3832
86ad330
27c3832
 
 
86ad330
27c3832
86ad330
27c3832
86ad330
27c3832
86ad330
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
---
tags:
- text-to-image
- stable-diffusion
- lora
- diffusers
- template:sd-lora
widget:
- text: >-
    caricature of a asian woman with disappointed expression, oversized big
    chin, wearing a Folk costume, white background, exaggerated facial features 
    <lora:caricature_sdxl_v2:1>
  output:
    url: images/00543-3110114300.png
- text: >-
    caricature of a middle eastern kid with amazed expression, oversized big
    ears, wearing a 60's style outfit, white background, exaggerated facial
    features  <lora:caricature_sdxl_v2:1>
  output:
    url: images/00488-599893346.png
- text: >-
    caricature of a caucasian woman with drowsy expression, oversized big eyes,
    wearing a Leather jacket, white background, exaggerated facial features 
    <lora:caricature_sdxl_v2:1>
  output:
    url: images/00493-3833057062.png
- text: >-
    caricature of a black kid with amazed expression, oversized big eyes,
    wearing a Superhero costume, white background, exaggerated facial features 
    <lora:caricature_sdxl_v2:1>
  output:
    url: images/00496-3581784488.png
- text: >-
    caricature of a caucasian man with amazed expression, oversized big ears,
    wearing a Jogging suit, white background, exaggerated facial features 
    <lora:caricature_sdxl_v2:1>
  output:
    url: images/00502-1038589121.png
- text: >-
    caricature of a black man with skeptical expression, oversized big mouth,
    wearing a Hip hop gear, white background, exaggerated facial features 
    <lora:caricature_sdxl_v2:1>
  output:
    url: images/00504-2768598054.png
- text: >-
    caricature of a indian kid with happy expression, oversized big ears,
    wearing a Dungarees, white background, exaggerated facial features 
    <lora:caricature_sdxl_v2:1>
  output:
    url: images/00505-2065322002.png
- text: >-
    caricature of a middle eastern man with happy expression, oversized big
    ears, wearing a Hawaiian shirt, white background, exaggerated facial
    features  <lora:caricature_sdxl_v2:1>
  output:
    url: images/00527-2557789390.png
- text: >-
    caricature of a asian man with sad expression, oversized big ears, wearing a
    Linen shirt, white background, exaggerated facial features 
    <lora:caricature_sdxl_v2:1>
  output:
    url: images/00542-2851304771.png
base_model: stabilityai/stable-diffusion-xl-base-1.0
instance_prompt: null
license: cc-by-nc-nd-4.0
datasets:
- Blib-la/caricature_dataset
---

# Caricature LoRA SDXL

## Captain: The AI platform that evolves to your needs

* 🚀 [Check out Captain](https://get-captain.com)
* 👩‍💻 [Captain on GitHub](https://github.com/blib-la/captain)



<Gallery />

[![Discord](https://img.shields.io/discord/1091306623819059300?color=7289da&label=Discord&logo=discord&logoColor=fff&style=for-the-badge)](https://discord.com/invite/m3TBB9XEkb)

## Model Overview

This model card showcases a LoRA (Low-Rank Adaptation) model trained on our proprietary [Caricature Dataset](https://huggingface.co/datasets/Blib-la/caricature_dataset). The model is fine-tuned to specialize in generating exaggerated and distinctive caricature images, drawing from a diverse set of AI-generated portraits.

## Training Configuration

- **Dataset**: Proprietary Caricature Dataset created via Stable Diffusion (SDXL)
- **Epochs**: 16
- **Number of Images**: 174
- **Repeats per Image**: 10 (Each image was utilized 10 times during training to reinforce learning)
- **Optimizer**: DAdaptAdam (An advanced optimizer for efficient and dynamic AI training)
- **Precision**: bf16 (Chosen for the optimal balance of performance and computational resource management)
- **Main Trigger**: Keywords like “caricature” prime the model to generate images within the caricature domain.
- **Xformers**: Enabled (Enhancing transformer model efficiency)
- **Captioning Method**: GPT-Vision (Employed to generate relevant captions, crucial for token shuffling in training)
- **Base Model**: Stable Diffusion XL 1.0 (A robust foundation for image generation tasks)

## Model Usage

Employ this model to create a wide variety of caricatures, each with exaggerated features that highlight the subject's distinct characteristics in a stylized manner.

## Performance and Limitations

- **Performance**: Exhibits a strong ability to vary facial features creatively and with high fidelity to the caricature art style.
- **Limitations**: May exhibit less diversity in scenarios not covered by the 174 training images.

## Ethical Considerations

- **Intended Use**: The model is purposed for creative and educational applications, particularly in the arts and entertainment sectors.
- **Bias and Fairness**: Attention has been paid to ensure a diverse representation within the dataset to mitigate biases.


## Licensing

- **Model License**: Licensed under Creative Commons Attribution-NonCommercial-NoDerivs 4.0 International (CC BY-NC-ND 4.0) for non-commercial use.

## Contributions and Feedback

We welcome feedback and contributions to improve the model further. If you have suggestions or would like to contribute to the model's development, please reach out through the model's Hugging Face page.


## Trigger words

You should use "caricature" to trigger the image generation.

## Download model

Weights for this model are available in Safetensors format.

[Download](/Blib-la/caricature_lora_sdxl/tree/main) them in the Files & versions tab.

## Related

https://blib.la/blog/crafting-the-future-blibla-s-ethical-approach-to-ai-model-training

## Additional Usage Restrictions for Blibla's LoRAs Hosted on Hugging Face

In alignment with our commitment to ensuring the responsible and ethical use of our models, and in addition to the terms set forth in the Creative Commons Attribution-NonCommercial-NoDerivs 4.0 International License (CC BY-NC-ND 4.0) under which Blibla's LoRAs are licensed, we hereby impose the following specific restrictions:

1. **Prohibited Platforms**: Reuploading, redistributing, or offering of image generation services using our models on platforms not owned or operated by Blibla or Hugging Face is strictly forbidden. This includes, but is not limited to, any platforms that host, allow, or promote Not Safe For Work (NSFW) content. 

2. **Explicitly Forbidden Platforms**: For clarity, and without limiting the generality of the above, platforms including but not limited to Leonardo AI, Civit AI, and any "Hugging Face spaces" that host or permit NSFW content are explicitly prohibited from hosting, or utilizing Blibla's LoRAs in any form or manner.

3. **Responsibility of Users**: Users of Blibla's LoRAs are responsible for ensuring that the environments in which they use, share, or promote our models adhere strictly to these restrictions. Violation of these terms may result in revocation of the license granted under CC BY-NC-ND 4.0 and may prompt further legal action to protect the integrity of our models and the safety of the communities we serve.

4. **Purpose of Restrictions**: These restrictions are put in place to align with Blibla's ethical standards and the intended use of our models. They are designed to prevent associations with content or platforms that do not reflect our values or the intended application of our technology.

By utilizing Blibla's LoRAs, you acknowledge and agree to these additional restrictions, ensuring that the use of our models remains within the bounds of ethical and responsible practice.