1946 字
10 分钟
StableDiffusion:使用LoRA模型

1. 介绍#

  • 全称Low-Rank Adaptation模型
  • 目的:向AI传递、描述一个特征准确、主体清晰的形象,一般用于限定画面主体角色形象或者画面风格
  • 文件格式safetensors
  • 注意:LoRA模型需要与SD次代对齐使用,不能跨次代使用

2. 使用#

2.1 模型存放路径#

  • WebUImodels/LoRA
  • ComfyUImodels/loras

2.2 WebUI环境#

  • 附加模型选单中选择需要使用的Lora模型

附加模型选单

  • 提示词里输入:<lora:模型名称:权重>

    LoRA使用

2.3 ComfyUI环境#

  • 工作流的模型后面追加仅加载LoRA模型模型强度即为权重

    • SD 1.5 + LoRA

    LoRA使用

    • SDXL + LoRA

    LoRA使用

    • SD 3.5 + LoRA

    LoRA使用

    • FLUX + LoRA

    LoRA使用

2.4 权重设定#

​ 推荐使用0.4~0.8,可以确切保留特征,同时减弱对画风的影响。

2.5 模型搭配#

​ 在使用LoRA模型时,推荐搭配合适的基础模型进行使用——对应动漫风格写实风格渲染风格,以期达到最好的生图效果。

3. 示例#

模型系列类型内容LoRA模型
SD 1.5角色纳西妲纳西妲
SD 1.5元素手办blindbox_大概是盲盒
SD 1.5元素汝瓷非遗文化_国风汝瓷
SD 1.5元素汉服hanfu song 汉服宋风hanfu ming 汉服明风
SD 1.5风格沁彩沁彩 Colorwater
SD 1.5风格墨心色彩墨心MoXin
SD 1.5风格Q版手绘Q版手绘
SD 1.5风格吉卜力风格Studio Ghibli Style
SDXL风格清透水彩插画BLS-清透水彩插画
SD 3.5风格新海诚风格新海诚动漫风格
FLUX风格人像写实XLabs F.1 Realism LoRA_V1
FLUX风格纪实摄影纪实摄影 FLUX.1 LoRA
FLUX风格游戏渲染超现实高清渲染游戏背景图 v1.0
FLUX风格淡水彩F.1手绘淡水彩小场景治愈风插画

3.1 纳西妲#

AI生成图AI生成图
纳西妲纳西妲

3.2 手办#

AI生成图
手办
AI生成图AI生成图
手办手办
AI生成图AI生成图AI生成图
手办手办手办

3.3 汝瓷#

AI生成图AI生成图
汝瓷汝瓷
AI生成图AI生成图AI生成图
汝瓷汝瓷汝瓷

3.4 汉服#

AI生成图AI生成图
汉服汉服
汉服汉服

3.5 沁彩#

AI生成图AI生成图
沁彩沁彩
沁彩沁彩
AI生成图AI生成图
沁彩沁彩
沁彩沁彩

3.6 墨心#

AI生成图
墨心
AI生成图AI生成图
墨心墨心

3.7 Q版手绘#

AI生成图
Q版手绘
AI生成图AI生成图
Q版手绘Q版手绘
Q版手绘Q版手绘

3.8 吉卜力风格#

AI生成图AI生成图
吉卜力吉卜力
吉卜力吉卜力

3.9 清透水彩插画#

AI生成图AI生成图
清透水彩插画清透水彩插画
清透水彩插画清透水彩插画

3.10 新海诚风格#

  • 提示词

    • city on a clear cloudless day,beautiful city,highly detailed, high resolution,
  • 生成图

AI生成图AI生成图
新海诚风格新海诚风格
新海诚风格新海诚风格

3.11 人像写实#

  • 提示词

    • model headshot, studio photography, the image features only the model without any additional elements, with a light gray
    • a man, model headshot, studio photography, the image features only the model without any additional elements, with a light gray
  • 生成图

AI生成图AI生成图
人像写实人像写实
人像写实人像写实

3.12 纪实摄影#

  • 提示词

    • Film Photography,a quaint street scene bathed in the warm,A vintage bicycle with a basket is parked against the wall of a building,casting a long shadow on the cobblestone path. The building is adorned with vibrant orange foliage,which adds a striking contrast to the otherwise muted tones of the wall and path. A sign reading "Vintage Train - Pro Digital Economy - Maisie Robbie" hangs prominently on the building,suggesting a business or shop. The overall atmosphere is serene,evoking a sense of timeless charm and tranquility. The interplay of light and shadow,
    • Film Photography,seaside,reef,lighthouse,
    • Film Photography,city on a clear cloudless day,beautiful city,Highly detailed,
    • Film Photography,an elderly man seated in front of a textured and ornately designed wall. The wall depicts weathered architectural details with layers of peeling paint and intricate carvings,rendered in earthy tones of green and brown. The man,whose presence is contemplative and calm,gazing off to his left,wears a simple beige jacket over a green shirt. His hair and full beard are gray,and his posture is relaxed but upright,suggesting a quiet dignity or introspection. The color palette of the scene is muted,mainly consisting of greens,browns,and grays,which harmonizes the man with his surroundings,blending the lines between the subject and the backdrop. His facial features are soft,with an expression that evokes a sense of wisdom or pensiveness. The refined decay of the background contrasts with the natural aging of the man,highlighting themes of time and permanence.,
  • 生成图

AI生成图AI生成图
纪实摄影场景摄影
纪实摄影纪实摄影
AI生成图AI生成图
纪实摄影场景摄影
纪实摄影纪实摄影
AI生成图AI生成图
纪实摄影场景摄影
纪实摄影纪实摄影
AI生成图AI生成图
纪实摄影场景摄影
纪实摄影纪实摄影

3.13 游戏渲染#

  • 提示词

    • Realism blends with natural light.,colorful lines in a flat style,van gogh is painting style,In the vast expanse of the desert,there is a refreshing miracle-the desert oasis. Here is the most mysterious and gentle brushstrokes of nature,quietly injecting the vitality of life into this seemingly dead sand sea,At the edge of the oasis,the soft yellow sand gently undulates in the breeze,as if it is the breath of the earth,gentle but with a trace of imperceptible rhythm. With the deepening of the footsteps,the exciting green gradually comes into view,forming a sharp and shocking contrast with the surrounding golden yellow. The tall date palm trees stand tall and straight,and their branches and leaves sway gently under the scorching sun,casting a shadow of alienation,it provides a rare shady place for passing travelers,Under the trees,patches of green grass spread out,and glittering dewdrops hung on the fine grass leaves,shining with attractive light in the morning light or sunset. Occasionally,small animals can be seen shuttling through the grass,either agile desert foxes or shy antelopes,enjoying rare peace and abundance in this paradise of life,In the middle of the oasis,a clear spring lies quietly. The water surface is like a mirror,reflecting the blue sky and white clouds and the green around it. It is intoxicating. The spring water is crystal clear and cool and pleasant. It is the source of thirst for desert travelers. At the water's edge,wild flowers are blooming and colorful. Although they are inconspicuous,they dot every corner of this barren land with tenacious vitality,sending out light fragrance and dancing butterflies,attracting bees,deducing the hymn of life,As night falls,the oasis is even more mysterious. The starry sky is washed and starry. The Milky Way crosses the sky and complements the lights on the ground,creating a dreamy atmosphere. The breeze blows and brings a little coolness. It is in sharp contrast to the heat of the day,making people relaxed and happy,as if all the fatigue,
    • Realism blends with natural light.,Under the azure sky,a continuous stretch of golden sand gently embraces the azure sea,forming a peaceful and magnificent painting. The sunlight penetrates through the thin clouds like fine threads,sprinkling on the delicate beach. Every grain of sand seems to be coated with a thin layer of golden radiance,shimmering with a soft and charming light., The sea breeze brushes gently,carrying the faint salty taste of the seawater and the freshness of distant flowers and plants. It brushes over my face,taking away all the fatigue and noise,leaving only the tranquility and freedom of my soul. The waves beat against the shore,making pleasant sounds. They either gently caressed the beach or rose passionately,leaving white foam,then slowly receded,leaving wet traces,like the sea telling its ancient and mysterious story., In the distance,the sea and sky merge into one color,unable to distinguish where the end of the sky is and where the beginning of the sea is. A few seagulls are soaring on the sea surface,either flying low over the waves or singing high in the blue sky,free and carefree,adding a touch of vitality and energy to this peaceful seaside. On the beach,occasionally a few small crabs can be seen rushing through the sand holes,or a few colorful shells washed ashore by the waves,lying quietly on the beach,waiting for someone to pick them up., At sunset,the horizon gradually became a brilliant orange red,with golden sunlight shining in harmony with the waves on the sea. The entire beach was enveloped in a warm and romantic atmosphere. People sit or lie on the beach,enjoying the tranquility and beauty. Some quietly watch the waves,while others bow their heads and pick up seashells. Everyone's face is filled with a satisfied and happy smile.,
    • Realism blends with natural light.,The lively night market,with food stalls and street stalls on both sides,is very lively.,
  • 生成图

AI生成图AI生成图
游戏渲染游戏渲染
游戏渲染游戏渲染
游戏渲染游戏渲染

3.14 淡水彩#

  • 提示词

    • watercolor scene,Hand-painted watercolor illustrations.A quaint bookstore with a charming garden entrance,inviting passersby to explore its literary treasures,under blue skies and white clouds.,
    • watercolor scene,Hand-painted watercolor illustrations.A corner convenience store under blue skies and white clouds.,
    • watercolor scene,Hand-painted watercolor illustrations.A cozy bakery with a charming outdoor seating area, inviting passersby to enjoy fresh bread and pastries.
  • 生成图

AI生成图AI生成图
淡水彩淡水彩
淡水彩淡水彩
淡水彩淡水彩
封面
示例歌曲
示例艺术家
封面
示例歌曲
示例艺术家
0:00 / 0:00