We are launching IP Adapter on Scenario, here is a quick look and overview of what it is
IP-adapter (Image Prompt adapter) is a Stable Diffusion add-on for using images as prompts. You can use it to copy the style, composition, or a face in the reference image.
With this powerful tool you can create consistency and variations fast.
For example, I used the simple prompt: 'a woman with black hair' on our Platform Model: Creepy Nordic + Belgian + Semi-Realistic to produce the following image:
By dragging and dropping this image onto the 'Reference Image' area of the inference bar, and selecting 'IP Adapter' for the Reference Image Mode, at Influence: 50 I simply type the prompt: 'blue eyes':
And just like that, we get a consistent result with the eye color change without any Sketching or use of a Canvas:
Here are some more prompt examples, remember you may need to adjust the influence to get the right balance between consistency and new added elements. The higher the influence the more adherence to the Reference Image will be maintained.
wearing glasses
chef
smiling
Don't forget about our Prompt Expressions for very fine control over the weight of your prompts
(blonde hair)+
By Selecting the Reference Image Mode ControlNet + IP Adapter you can further manipulate your results. Here we are using a picture of a dancing man, Character Mode for ControlNet at Influence: 50 and our Reference Image with IP Adapter Influence: 50 with the prompt: 'woman dancing':
And here is the result:
IP Adapter is also useful with the LCM Scheduler. You can read about the LCM scheduler here: Using the LCM Scheduler
The LCM Scheduler generates much faster but can result in significant loss of quality.
In our tests, we have determined that LCM can be leveraged with the help of IP Adapters to maintain a consistent subject without sacrificing overall quality beyond an acceptable threshold. Outputs with LCM which previously only maintained 20-30% coherence as compared to the default scheduler, landed much closer to 70-80% consistency and fidelity.
-
As above, add your character image to Reference Image and switch to IP Adapter Control. This works best with Influence set to around 50.
-
Set the LoRA to the LCM Scheduler and adjust the guidance to 1.5
We will continue to develop new workflows using IP Adapters and share them here on our Knowledge Center as well as on our Social Media accounts. Stay tuned for more exciting content and in the meantime you can check out the useful links below to research how IP Adapter is being used in the community at large so you can run your own experiments and create new pathways to creativity with Scenario!
Face Swap in Stable Diffusion Using IP Adapter & ControlNet