Reference images give you more control over the final look. They let you guide the AI to nail specific colors, patterns, or layouts. This article walks you through how to use reference images with ControlNet or Image-to-Image to create awesome albedo maps
Reference Image Modes
Let’s start with the interface you’ll be using, as shown in the image. On the left side, you’ll see the Reference Image tab, this is where you bring in your reference. You’ve got options: upload your own image, pick one from Scenario’s image gallery, or draw a quick sketch right there in the tool.
After choosing the reference image, the Mode dropdown lets you pick between Image-to-Image and Structure.
Influence Slider will be displayed after uploading a reference image. It lets you tweak how much the reference shapes the output, so you can find the sweet spot between sticking to it and letting the AI get creative. Here’s what each mode does for your textures.
Image-to-Image Mode
What It Does: This mode uses your reference image to guide the color palette and overall vibe of your texture. It pulls in the hues, lighting, and details from your uploaded image (or sketch) and applies them to the albedo map, keeping things pretty close to what you provided.
Settings: The Influence Slider is your main control here. Set it low for a looser take where the AI adds some of its own flair, or crank it up to lock in the reference’s colors and style. It’s great for nailing a specific mood or aesthetic.
Example: As shown in the image below, uploading a sketch of weathered wooden boards with rusty metal strips lets the AI grab this simple sketch with basic colors and shapes. It blends them into your prompt and Influence setting, giving you a texture that feels true to that worn-out, rustic style.
Structure Mode
What It Does: This mode takes your reference image as a blueprint for the structure, keeping the shapes and arrangement intact, while letting the AI fill in the details based on your prompt.
Settings:
Influence Slider: Controls how strictly the AI sticks to the reference’s layout. Lower it for some wiggle room, or push it higher to enforce the exact structure.
Duration Slider: Adjusts how much the AI refines the pattern over time, higher values mean more detail but might slow things down.
Example: As shown in the image below, uploading a picture of scattered rocks, small stones, and brown twigs in Structure mode lets the AI mimic that natural, uneven layout. It then adds a grassy green surface across the texture based on your prompt, keeping the pattern consistent and seamless.
Quick Tips
Influence Value: Experiment with the influence to get the perfect mix. Too low and the reference fades away, too high and the result can feel rigid.
Sketch Tool: Drawing a sketch with ControlNet is awesome for nailing precise patterns. Aim for an influence of 50-70% to keep it balanced and effective.
Edge Caution: When sketching, be careful around the edges. Drawing too close can break the seamless look, so leave a small gap to keep everything smooth.
Using reference images in Scenario with ControlNet makes crafting seamless textures a breeze. Whether you go with Image-to-Image mode to nail the colors and vibe or Structure mode to lock in patterns, you’ve got the tools to create exactly what you need. Play with the sliders, tweak your sketches, and watch your textures come to life, ready for games, renders, or whatever you’re working on. With a bit of experimenting, you’ll be pumping out pro-level materials in no time!
Practical Examples
Metallic Armor
Settings: Realistic Textures 2.0 model, Structure mode with a reference image of white lines forming triangles on a black background.
Prompt: “A rugged armored metal plate surface showing signs of use, with scratches, dents, and patches of rust. The texture displays muted metallic grays and dark tones, conveying a sense of strength and durability with marks of wear from battles.”
Result: Seamless, rugged armor with a worn out texture, ready for real-time rendering in a fantasy game environment.
Golden Horse Emblem
Settings: Realistic Textures 2.0 model, Image-to-Image mode with a reference image uploaded in Scenario. The reference is a simple sketch of an emblem in gold tone.
Prompt: “Golden horse head sculpture is intricately framed by ornate swirls on a beige marble textured background, enhancing the elegance and antique appearance of the art.”
Result: A seamless, luxurious wall texture featuring a detailed golden horse head emblem with intricate scrollwork, set against a delicate marble background, perfect for a high-end architectural render.
Access This Feature Via API
Upload an Image: Scenario API Documentation - POST /assets
Text-to-Texture Generation: Scenario API Documentation - POST /generate/txt2img-texture
Image-to-Texture Generation: Scenario API Documentation - POST /generate/img2img-texture
ControlNet-to-Texture Generation: Scenario API Documentation - POST /generate/controlnet-texture
Texture Maps Generation: Scenario API Documentation - POST /generate/texture