**SD-32 ControlNet 應用(九典)**

DALL-E 強調與 ChatGPT 的集成和高質量的圖像生成，Midjourney 提供多樣的風格和專業模式，而 Stable Diffusion 則以其開源且可自行訓練微調模型著稱。除了目前SD1.5、SD2.0及SDXL完全開源之外，也有相當活躍的開發者社群 (CivitAI:https://civitai.com/) 為其提供了大量免費高質量的訓練模型和插件，並且持續維護更新。
不過 SD3 model 於2024年6月12日發布，但其許可證引發許多爭議，且改為收費。

ImageToPrompt.com 的使用方式非常簡單，點擊上方進到網站之後，就把你要轉成 Prompt 提示描述指令的圖片上傳。但目前已改為收費
[ImageToPrompt.com ](https://imagetoprompt.com/dashboard)

**ControlNet的應用**
ControlNet v1.1：官方網址
https://github.com/lllyasviel/ControlNet-v1-1-nightly

ControlNet v1.1：完整指南 - 穩定的擴散藝術 (stable-diffusion-art.com)
https://stable-diffusion-art.com/controlnet/
ControlNet 是一種穩定擴散模型，可讓您從參考圖像中複製構圖或人體姿勢。
經驗豐富的穩定擴散使用者知道生成您想要的確切成分有多難。圖像有點隨機。您所能做的就是玩數位遊戲：生成大量圖像並選擇您喜歡的圖片。
借助 ControlNet，穩定擴散用戶終於有了一種精確控制拍攝物件位置和外觀的方法！

教學影片
EVERYTHING YOU NEED TO KNOW to get started with CONTROLNET
https://www.youtube.com/watch?v=YgWv4zLZ1rk

**IP-Adapter官網**
https://huggingface.co/h94/IP-Adapter
ControlNet中的IP-Adapter是一個微調的模型 作法類似用一張參考圖來影響AI運算

**下載LoRA model:building cut**
https://civitai.com/models/485146/building-cut
**下載LoRA modelESarch_handmodel_v3**
https://civitai.com/models/84240
檔案放置路徑 **\stable-diffusion-webui\models\Lora

**加強Prompt的權重**
Prompt越前面權重越大 prompt token超過70個後影響微弱
((Best quality)),((masterpiece)),((realistic)),
(masterpiece:1.2)
視角選擇
floor plan（平面圖），aerial view（鳥瞰圖），human perspective（人視圖）,view from street,font view,facede,perspective,aerial view

**要使用底圖(不管3D或手繪)建議先進行圖面尺寸調整**
**3D立面線稿圖**
原圖大小 (1924x1167) Resize 為 (1024x624)

Prompt:((Best quality)),((masterpiece)),((realistic)),outdoors,modern apartment,front view,urban background,landscape,4K uhd,architecture photo
Negative Prompt:noisy,ugly,low quality,deform,blurry,night,
**啟用一個ControlNet:MLSD**
Model: ArchitectureRealMix_v1
1
2
3
Model: realistic_v10BAKEDVAE

**啟用二個ControlNet:MLSD+Depth**
Model: realistic_v10BAKEDVAE
Prompt:masterpiece,best quality,outdoors,modern 12 floors apartment,view from street,city,landscape,4K uhd,day time,house,[concrete|wooden],
Negative Prompt:noisy,ugly,low quality,deform,blurry,night,


1

**啟用二個ControlNet MLSD:0.7+IP-Adapter:0.5**
風格影響的圖片1


Model: ArchitectureRealMix_v1
Prompt:Urban regeneration project in suburban Taichung,green building materials and glass facade,front view,enhancing urban environmental quality,
Negative Prompt:Rural landscapes,traditional villages,
2
3

**3D立面圖(596x768)**
Model: realistic_v10BAKEDVAE
Prompt:architecture facade, modern apartment building,view from street, highly detailed

Negative Prompt:drawing, painting, crayon, sketch, graphite, impressionist, noisy, blurry, soft, deformed, ugly

**啟用一個ControlNet-depth_leres++:0.95**

**啟用二個ControlNet:Depth+IP-Adapter:0.75**


**3D透視底圖**
原圖大小 (3840x2160) Resize 為 (1024x576)

**啟用二個ControlNet:Depth+MLSD**
1
2
3
4 sketch&line Art

**啟用二個ControlNet Canny:0.7+IP-Adapter:0.5**
風格影響的圖片1

5
**啟用二個ControlNet Canny:0.7+Reference:0.5**
6

**3D透視底圖**
原圖大小 (3840x2160) Resize 為 (1024x576)

Prompt:masterpiece,best quality,building,outdoors,modern 12 floors apartment,view from street,city,landscape,4K uhd,day time,house,high detailed,
Negative Prompt:noisy,ugly,low quality,deform,blurry,night,
Model: ArchitectureRealMix_v1
**啟用一個ControlNet:Lineart**

1
2
3 更換Model: realistic_v10BAKEDVAE
4 更換Model: realisticVisionV60B1_v60B1VAE
Prompt加入concrete
5更換Model: twingShadow_v20
**Lora modle是一種微調模型 會增加某種特殊風格或效果**
**加入Lora**:<lora:0512sketch05:0.6>,及觸發詞:sketch,building
6 sketch style
使用ComfyUI (只是提供不同效果比較)

**3D室內透視底圖一**
原圖大小 (960x540) Resize 為 (912x512)

Prompt:a staircase in a building with people walking up it,(orange color:0.7),1 staircase,artistic impression,interior architecture view,vibrant and dynamic,low angle dimetric rendering,large staircase,highly rendered,

Negative Prompt:noisy,ugly,low quality,deform,blurry,night,
Model: interiordesignsuperm_v2

**啟用一個ControlNet:Canny**




**ControlNet:Shuffle 可以改變圖片中的彩度**




Prompt加入[orange|white] color

提示詞的描述稍作修改
Prompt:A modern,spacious indoor area with a wide staircase in the center,flanked by glass walls that allow natural light to fill the space,Orange accents adorn the ceiling and staircase supports,Several people are seated or walking,engaging in various activities,Some are sitting on comfortable lounge chairs,while others are walking or conversing,open design,

Neon Noir
3D Model

**3D室內透視底圖二(1024x488) **

Model: ArchitectureRealMix_v1
Prompt:masterpiece,best quality,interior,indoor swimming pool,modern ceiling design,RAW photo,soft lighting,high quality,floor,

Negative Prompt:NSFW,(normal quality),(low quality),(worst quality),deformed,disfigured,

啟用ControlNet-canny:0.9


再啟用ControlNet-IPAdapterR:0.4




**3D室內透視底圖三(1024x768)**

Model: realistic_v10BAKEDVAE
Prompt:masterpiece,interior,arafed view of a lobby with a reception counter and a large window,interior architecture view,high quality rendering,wooden,warm,sweet,<lora:Modern simple and bright office lobby morden:0.5>,

**啟用ControlNet-canny:0.75**
**再啟用ControlNet-IPA:0.4**

**3D室內透視底圖四(1024x504)**

Model: realistic_v10BAKEDVAE
Prompt:masterpiece,Elementary school library interior,bright colors,lobby,public stair,masterpiece,best quality,photorealistic,modern interior design,lighting,<lora:bokk_20230608042435:0.7>,bok,
**啟用ControlNet-lineart:0.85**



**3D室內透視底圖五(1024x460)**

Model: interiordesignsuperm_v2
Prompt:masterpiece,interior,lobby with big stairs with orange color,bright colors,interior architecture photo,wide angle,high quality,
**啟用ControlNet-canny:0.75**


**3D室內透視底圖六(1024x456)**

Model: interiordesignsuperm_v2
Prompt:masterpiece,interior,open office,bright colors,interior architecture photo,wide angle,high quality,
**啟用ControlNet-canny:0.75**


**剖面底圖七(1024x720)**

Model: ArchitectureRealMix_v1
Prompt:HDR photo of ((masterpiece)),(best quality),(highres),8k,section drawn,outline,Building profile,building structure,trees,details,pure background, . High dynamic range, vivid, rich details, clear shadows and highlights, realistic, intense, enhanced contrast, highly detailed

Negative Prompt:NSFW,(low quality:1.4),deformed,(distorted:1.3),poorly drawn,ugly,blurry,text,night,
**啟用ControlNet-canny:0.9**
**加上Lora 及觸發詞 <lora:buildingcut:0.8>,building cut**


**加上Lora 及觸發詞 <lora:HM:1>,HM01**

**啟用ControlNet:IstructP2P**
make it lightning storm
make it at sunset
make it at night time

make it snow or make it winter

make it on fire
(make it at X'mas night:1.5)

**Extras 附加功能**
Upscaler 放大演算法