IP Adapters
      Back to home
      1. Scenario Knowledge Center
      2. Advanced Image Creation Tools
      3. IP Adapters

      Beginner's Guide to IP Adapters in Game Design

      There are many ways to use IP Adapters, here are some tips to get you started

      To use IP Adapters:

      1. Add image to the Reference Image section.

      2. Switch to IP Adapters (or one of the + IP Adapters options.)

      3. Adjust the influence as needed.

      Screenshot 2024-02-12 at 12.30.47 PM   GF-e_88WoAEeGMP

      The Model you use matters

      If you want your character or creation to be in the same style*as your reference image, you must train or pick a model in the same style or a close stylistic match.

      YOU DO NOT NEED COMPLEX PROMPTS.

      IP Adaptors are Image Prompts. It is taking into context what it senses from your image.
      If you have a portrait of a woman as your reference image, you probably don't need to say "portrait of a woman in the prompt" unless you're having trouble making a woman appear.
      The prompts I use are super simple. Like this:
      • Running
      • Laughing
      • Break Dancing
      • Doing Kung Fu

      GF-gZXrXAAAzy1CGF-ga5bWwAAi2uj

      IP ADAPTERS WORK BETTER FOR NON-REALISM

      This is an unfortunate truth, and one we are investigating more, but do not expect the IP Adapters to work quite as magically for photorealistic images.

      THE INFLUENCE IS VARIABLE

      AI relies on Probability.

      As a general rule of thumb, 0.50 influence is a good starting off point.

      However, depending on how much the model associates the image you use with the model you are prompting from, you may need to go much higher or lower in influence.

      • If you use an image of a portrait, you may find that you need to heavily adjust the influence to create full body images.
      • If you use a lot of prompts, you may need to really increase the influence of your image.

      IP ADAPTERS + IMAGE to IMAGE or CONTROLNET

      We could, and will, write a whole article on IP Adapters and other reference image control methods together. They can be super powerful.

      The easiest, most direct method to try this out is by using a portrait in the IP Adapter and a Pose with ControlNet (Character Mode).

      GF-iL40XMAAfZ3k

      GF-iL4zXEAA0ARZ   GF-iOF7XoAAtc-D