Try   HackMD

Automatic 1111 Photoshop Plugin install on Mac OS + Stable diffusion running in Runpod.io

Goals: Install photoshop plugin and setup plugin, then, run through a couple basic modes of generation using the plugin.

Non-goals: Delivering 2000lbs of dog food to Rutland.

If you just want to see how awesome this plugin is, check out this demo video from the author, on Reddit.

Installation via .ccx file

First: Close/exit photoshop.

Then download: Auto.Photoshop.SD.plugin_v1.4.1.ccx

Then double click the file and Adobe creative cloud should ask a couple questions and close it for you.

(optional) Backup method: Using The Unzip Method on MacOS

First: Close/exit photoshop.

This is "The Unzip Method" of installation from the README.

Download this file: Auto.Photoshop.SD.plugin_v1.4.1.zip

Extract that Zip file to it's own new directory.

Open it, and put the directory there into the Adobe Photoshop -> Plug-ins folder.

image

Plugin setup

Let's set some basics for the plugin

  • Switch the radio button to inpaint
  • Set the "sampling steps" to 35
  • Set the "selection mode" to precise
  • Set the denoising strength to approximately 0.4

image

Now scroll down

  • Set the "mask content" radio button to "original"
  • Click the "show samplers" button
  • Select the "DPM++ 2M" radio button for the sampler
  • Click the "hide samplers" button

image

Server setup

Next, navigate to the server tab on the top right

  • Set the SD URL to the URL that Doug gives you.
  • Select the "Automatic1111" radio button.
  • click SAVE for good measure.

image

Save the "custom preset"

Next, you can save these settings as a

From the "Stable Diffusion" tab on the top at the furthest left, scroll down and expand the "custom preset" accordion.

  1. Enter a name for the preset
  2. Click "generate preset"
  3. Click "save preset"

image

You can then load a preset by scrolling up to the main inpaint options area and from the drop down

image

Generating using txt2img

FIRST! Create a new image, I suggest 1024x1024

The first time you do this

  1. Click "refresh"
  2. Select "juggernaut XL" from the models list

Then, subsequent times, you'll do these steps:

  1. Enter a prompt
  2. Select the whole 1024x1024 pixels using the rectangle select tool
  3. Click the text 2 image button

image

Next click the Generate Txt2Img button.

sample1

This will generate an image on a new layer.

Click "generate more" to generate more images in the same layer (they can be selected through the plugin)

Generating using img2img

To generate using img2img

  1. Select the "img2img" radio button
  2. Modify the prompt if necessary
  3. Select the whole image (or a portion of it, optionally)
  4. Generate img2img

sample2

Modifying the denoising amount.

Adjust the denoising amount from 0-1, the higher the number: the greater the amount of change.

sample3

Generation using inpainting

  1. Select the "inpaint" radio button
  2. Create a new empty transparent layer
  3. Using the plain brush (100% hardness), draw over the area you want to change with a bright color, this is our "mask"
  4. Select the whole image (or, a portion of it) with the rectangle select tool.
  5. Click "generate inpaint" (not illustrated)

sample4

Results with 0.56 denoise

Using "inpaint at full res"

This essentially zooms in and details JUST the area you masked. It's good for detailing. Usually it requires a higher denoise.

  1. Scroll down in the plugin window and select the "inpaint at full res" checkbox
  2. Create a new empty layer, paint a mask
  3. Select the whole image with the rectangle select tool
  4. Click "generate inpaint" (not illustrated)

sample6

Results with 0.43 denoise

sample7

Overpainting (and photo bashing)

In new layers, stub in what you'd like using photoshop tools / reference images / other generation, in this case, I add straps to the dress and a glass of whisky

sample8

Now, use inpainting as per normal

  1. Modify the prompt, here I add emphasis on dress straps and a glass of whisky
  2. Create a new layer, and draw your mask on it using the brush tool
  3. Select the whole image (or a part of it)
  4. Click "generate inpaint" (not illustrated)

sample9

Results at a 0.50 denoise. (It also used "inpaint at full resolution")

sample10

References: