强烈推荐 Anime Illust Diffusion XL这个模型,模型的绘画能力非常强,融合了许多画师,通过提示词即可触发
V0.6下载地址
https://civitai.com/models/124189/anime-illust-diffusion-xl?modelVersionId=266214
Anime Illust Diffusion XL Style Prompt Test丨Anime Illust Diffusion XL模型全风格Tag测试文档
AnimeIllustDiffusionXL风格tag预览-V0.6.xlsx
II 模型介绍
动漫插画设计XL,或称 AIDXL 是一款专用于生成二次元插图的模型。它内置了 200 种以上(随着更新越来越多)的插画风格,依靠特定触发词(见附录 A 部分)触发。
优点:构图大胆,没有摆拍感,主体突出,没有过多繁杂的细节,认识很多动漫人物(依靠角色日文名拼音触发,例如,“ayanami rei”对应角色“绫波丽”,“kamado nezuko”对应角色“祢豆子”)。
模型难度较大,不推荐入门者使用。
III 使用指南(将与时俱进)
推荐使用 ComfyUI 生成图像……
现在,WebUI和ComfyUI在生成式无明显差别。
1 生成参数
用法一:直接使用
即直观地,在文生图中直接使用触发词触发风格。
用法二:风格化
即在图生图中使用触发词和 0.5~0.65 的重绘强度,为图像添加触发词对应的风格。
如果您无法生成与预览图相似的图像,请参照以下指南。
- 建议图像总分辨率(总分辨率=高度x宽度)大于 1024x1024 且 小于 1024x1024x1.5,否则生成的图像可能质量不高。此为经验法则,即生成图像的总分辨率应高于训练集图像的总分辨率,且同时低于训练集图像总分辨率的 1.5 倍,以防止模糊和畸变。例如,本模型在 1024x1024 总分辨率上训练,因此您最大可以生成 1024x1536(以 2:3 为例)分辨率的图像。
- 推荐使用 自然语言 + tags 的形式书写正面提示词。提高自然语言中的名词密度,避免使用抽象形容词,或用多个形容词叠加地修饰名词。另外,无需使用过多负面提示词。建议负面提示词数量不超过10个。
- 不进行“Clip Skip”操作,即 Clip Skip = 1。
- 采用 “dpmpp_2m” 采样器(sampler),搭配 “karras” 调度器(scheduler),该组合在 webui 里称为 DPM++ 2M Karras。在 7 CFG Scale 上采样 35 步以上。
- 仅需要使用模型本身,而不使用精炼器(Refiner)。
- 使用基底模型 vae 或 sdxl-vae。
- 使用附录部分提供的触发词以活用风格化。注意,从v0.5版本开始将支持部分质量提示词,如 best quality, masterpiece 等。使用它们将提高图像平均的美学质量(并不总是)。
2 注意事项
- 使用 SDXL 支持的 VAE 模型、文本嵌入(embeddings)模型和 Lora 模型。注意:sd-vae-ft-mse-original 不是支持 SDXL 的 vae;EasyNegative、badhandv4 等负面文本嵌入也不是支持 SDXL 的 embeddings。
- 生成图像时,强烈推荐使用模型专用的负面文本嵌入(下载参见 Suggested Resources 栏),因其为模型特制,故对模型几乎仅有正面效果。
- 由于初步训练,版本新增触发词将在当前版本效果相对较弱或不稳定。
3 实验
- 触发词所指向的风格能够相互融合而产生新的风格。
- 自 v0.5 版本开始,新增了质量提示词。
IV 训练参数
以 SDXL1.0 为底模,使用大约 2w 张自己标注的图像在 5e-6 学习率,循环次数为 1 的余弦调度器上训练了约 100 期得到模型 A。之后在 2e-7 学习率,其余参数相同的条件下,训练得到模型 B。将模型 A 与 B 混合后得到 AIDXLv0.1 模型。
V 对比基于 SD1.5 的 AID
2023/08/08:AIDXL 使用与 AIDv2.10 完全相同的训练集进行训练,但表现优于 AIDv2.10。AIDXL 更聪明,能做到很多以 SD1.5 为底模型无法做到的事。它还能很好地区分不同概念,学习图像细节,处理对 SD1.5 来说难于登天的构图,几近完美地学习旧版 AID 无法完全掌握的风格。总的来说,它绝对拥有比 SD1.5 更高的上限,我会继续更新 AIDXL。
Appendix / 附录
A. Trigger Words List / 触发词列表
v0.1 & v0.2: by 35s00, by 3meiji, by 5eyo, by 7nu, by 7thknights, by adenim, by agm, by ajimita, by akizero, by ame929, by anmi, by anteiru, by arutera, by ask, by atelier irrlicht, by bunbun, by caaaaarrot, by camu, by canking, by ccroquette, by chi4, by chicken utk, by chon, by cola, by cutesexyrobutts, by darumakarei, by dino, by dora, by dsmile9, by ei maestrl, by ekita kuro, by ekita xuan, by eku uekura, by fadingz, by fajyobore, by foomidori, by freng, by fuzichoco, by gesoking, by gomzi, by hachisan, by hakuhiru oeoe, by hamukukka, by haru, by hata, by hidulme, by hikinito0902, by hinaki, by hitoimim, by hitomio16, by hizumi, by homutan, by hotatenshi, by houk1se1, by hyatsu, by icecenya, by ichigo ame, by inoriac, by iromishiro, by iwzry, by jnthed, by joezunzun, by junsui0906, by karohroka, by kaya7hara, by kazari tayu, by killow, by kin, by kinta, by kishiyo, by kitada mo, by kkuni, by konya karasue, by kooork55, by kot rou020, by krenz, by kurige horse, by kuroume, by lalalalack, by lemoneco, by lm7, by lovelymelm, by lpmya, by mar takagi, by matcha, by matsukenmanga, by melowh, by menou, by midori xu, by mika pikazo, by misumigumi, by miv4t, by mochizukikei, by mogumo, by momoco, by momoku, by morikuraen, by mqkyrie, by muina, by munashichi, by muryou tada, by myaru, by myc0t0xin, by myung yi, by nack, by naji yanagida, by nanmo, by nardack, by narue, by nekojira, by netural, by nezukonezu32, by nico tine, by nikuzume, by nine, by nineo, by ninev, by niwa uxx, by nixeu, by noco, by noodle4cool, by nounoknown, by noyu, by oda non, by omutatsu, by onineko, by palow, by panp, by pikuson, by poharo, by poire, by potg, by pro-p, by qooo003, by rai hito, by rattan, by reiko, by rella, by rhtkd, by rin7914, by roitz, by ryuseilan, by saberiii, by sais, by sakiika, by samip, by sanosomeha, by say hana, by scottie0073, by senryoko, by serie niai, by seuhyo99, by shal-e, by shimanun, by shirabii, by shiraishi kanoya, by shiren, by shirentutu, by sho, by sia, by siki, by silver, by solipsist, by some1else45, by sonomura00, by sooon, by star furu, by starshadowmagic, by starzin07, by sui 0z0, by sul, by sushi0831, by suzukasuraimu, by taiki, by takumi bis, by teffish, by tidsean, by tira27, by tsukiho tsukioka, by tsvbvra, by ttosom, by tukumi bis, by uiiv, by ukiatsuya, by umaiyo puyoman, by void, by wait ar, by walzrj, by wanke, by whoisshe, by wlop, by xilmo, by yejji, by yogisya, by yohan, by yomu, by yoneyama mai, by yosk6000, by yumenouchi, by yun216, by yunikon147, by yunsang, by ziyun, by zumoti4
v0.3 adds: by akita hika, by asaikeu, by atdan, by bannou, by bison, by bodhi, by bonnie23, by cell, by chela77, by coco1758, by ebkim, by eichi, by electrophorus, by fungi, by gekidan, by glutton, by hews, by hirohorn, by hle, by hlymoriia, by icomochi, by iumu, by jeone0, by kana dfy, by kikinoki, by kumori ufo, by kurige, by lam, by liaowen, by limuli ceey, by lirseven, by maenoo, by magotsuki, by marusin, by mechari, by minncn, by modare, by r1zen, by rag ragko, by rannou, by rolua, by rurudo, by saclia, by sai izumi, by takunomi, by tedineon, by torino, by tororoshanyao, by tsubonari, by uuuzan, by yamanokami eaka, by zumizumi
v0.5 adds: by 3333382, by agoto, by am1m, by apoco, by aroa, by asea, by asets96, by asicah, by attas, by ayanon, by baihuahua, by ballpa cohi, by buzhijinfeng, by chai, by choyeon, by ciwu, by criin, by cupoi, by demizu posuka, by diyokama, by eyyy, by futamotu, by ganet, by greembang, by han, by hapu, by hcc33, by hoodxart, by hxxg, by ikky, by imlllsn, by japste, by jeanorgan, by jhcoon, by jiaming, by jirujiaru, by jjjsss, by jlt4n, by jojomaki, by jue, by jumbo, by kaedelic, by katann, by kieed, by kinokohime, by kirin, by kji rozo, by kmgrn, by kookie, by ksorede, by kuroduki, by kyusoukyu, by laza, by letco, by linfi muu, by lingli, by lizhiyan360, by luenar, by mamenomoto, by mashilemo, by mayf42, by mgdown, by miaopulu, by michihasu, by misaka12003, by mitsuki sanagi, by mizokooohmygod, by moguta, by moyu marginal, by mygom, by myless23, by nbrush19, by necomi, by nekoshoko, by nemn, by ninebell, by nininisama, by njer, by nmk, by nocopyrightgirl, by noir, by novelance, by ohanatoomoti, by omao, by qysthree, by rumoon, by ruoganzhua, by saltsaltzome, by sanmuyyb, by sannso, by saturn, by senju yosiyuki, by shant, by sheya, by shirataking, by siokazunoko, by siu, by skyjack, by sogawa, by ssr susu, by swd3e22, by swkld, by tansuan, by terite3lio, by timo, by uenomigi, by unfairr, by xianyuliangryo, by xiaoluoxl, by yaegasinan, by yarn, by yktmr10, by ymqqq, by yolanda, by yuichohui, by yumo012, by yutomaru, by yuzuyomogi
v0.5 adds (quality / traditional style): impasto, pseudo impasto, photorealistic, cel shading, flat color, realistic, oil painting, sketch, 3d, vivid color, perspective
v0.6 adds: (The farther back, the weaker the thermotical effect)** by genkung, by miraiart, by ndgd, by unkoteru, by softpoltupo, by mumushui6, by mignon, by dish, by utann, by sqrta, by sora72iro, by goldcan, by damda, by tise00, by applepie, by jeze, by emyo2727, by fizrot, by ningen mame, by mgr akami, by tenoimu, by neg101, by snhiyori, by pumpkinspice, by dandypocky, by chongsangjun, by egk513, by kita, by sakedong, by momoimon, by qiandaiyiyu, by ruilur, by nima, by kuronoi, by rafa, by rsef, by misyune, by hajikkoneko, by meion, by uouo kuma, by sg924, by ryuseihashida, by kudo eru, by zombieke, by odaibako, by fuenze, by horz, by reoenl, by cirilla, **by skycappuccino, by bebefate, by noa, by buerq, by seanami, by movik, by zanya, by neco, by woyoudabing, by shino sto, by himehajime, by kazuha822, by moemoepiano, by amochin, by sii569, by as109, by bbulhorn, by otsudou, by rima, by shira mame, by hwan, by doyoon, by kyonta, by mk876, by renge, by uminonew, by antifreeze3, by kpring, by alkaloid, by hs225kr, by paindude, by chiyu1182, by kren, by eeyn, by 44c, by aamond777, by magister, by heatia, by gyoku seisyoku, by hakua, by hosiumix, by cc18, by natsume yochiki, by akimatutix, by blanc, by nelpiv, by iwawa, by nuok980, by yunpiv, by dramz89, by giki, by otenkiya, by ssomo, by whyingre, by shokuen, by timbougami, by dkxlek, by previeww0, by shoutyoun, by beanowl, by fenbanglaoda, by fujimiya, by hiji chaba, by nankaitimu, by wnlhzx, by woxingjin, by yu2maru, by olys, by eru, by livepiv, by yoyoleaf, by omochinoie, by 0kommn, by iamuu, by rielilu, by sakenomihiyoko, by urosu, by dain, by nablack, by maru, by seicho, by fkey, by oshioshio, by intensify, by rega, by orihira, by gordenzz, by kkonziam, by manus, by yukiman, by anchor, by juuuuubot7, by nonokuro, by rotarran, by toketa usanto, by zheshejing, by yangyoucai, by nantaj, by others, by hachihito, by congju, by shiba, by shuizhuroupianppp, by yoya, by noko, by oneko, by firstsan vicz, by greyash, by mkpiv, by oyasumipiv, by pinkmill, by nekopushi, by yoimon, by hotahotatenshi, by quan, by eli otto, by cat0lin, by lurenjia, by muloli, by teketo
B. Trigger Words Introduction / 触发词介绍
(Updating…)
- 写实风格(realistic):by wlop, by nixeu, by shal-e
- 卡通渲染(cel shading):by void, by 7thknights, by novelance, by ciwu, by homutan, by melowh
- 厚涂(impasto):by dino, by xilmo, by solipsist, by reiko, by some1else45, by noodle4cool, by unfairr
- 平涂(flat color):by uenomigi, by magotsuki, by 3333382, by eku uekura, by hakuhiru oeoe, by hamukukka, by haru, by hirohorn, by hizumi, by ichigo ame, by kooork55, by mitsuki sanagi, by qooo003, by nezukonezu32, by nico tine, by nocopyrightgirl, by sanosomeha, by sonomura00, by tsubonari, by tsvbvra, by tukumi bis, by ukiatsuya, by yktmr10, by yosk6000, by yutomaru