Using Reference Images for Skyboxes

Using Reference Images for Skyboxes

Introduction

Creating a skybox in Scenario is already a powerful way to craft immersive 360-degree environments, but adding a reference image can take your control to the next level. Whether you're aiming for a specific horizon layout, a particular cloud formation, or a distinct structural element like a mountain range, the Reference feature lets you guide the AI. By uploading a sketch or image as a reference, you can shape the composition of your skybox while still letting Scenario's AI enhance the details with your prompt.

The image above shows how a sketch can become a highly detailed skybox.

Using Reference Images

Step 1: Using a sketch as Reference

1. Log in to app.scenario.com and navigate to the left sidebar.

2. Click Skyboxes > +New to open the Skybox Generation screen.

3. In the Reference section, select the Sketch option to begin creating or upload your reference.

4. For sketches, focus on basic shapes like the horizon line, mountains, or cloud outlines, and use simple colors to indicate elements (e.g., blue for sky, green for trees).

5. If you're uploading an image, choose one that clearly shows the layout you want, such as a photo of a sunset with distinct cloud patterns.

Step 2: Choose a Reference Type

After adding your sketch or image, set the Reference Type to guide how the AI interprets your reference:

• Image to Image: This mode uses your reference to influence the colors and overall style of the skybox. For example, if your sketch has a bright orange sunset with fluffy clouds, the AI will replicate those hues and shapes.

• Structure: This mode preserves the structural layout of your reference, such as the shape and arrangement of elements like trees or buildings on the horizon.

• Depth: This mode focuses on the depth information in your reference, emphasizing the spatial layout. If your sketch includes distant mountains, the AI will adapt to their placement and depth.

The image above shows the three Reference Types

Step 3: Adjust the Influence and Duration Sliders

Influence: Controls how strongly the reference image affects the final result. As shown, "Higher values amplify the weight of the reference image." Find a balance between:

• Lower values: More creative freedom for the AI

• Higher values: Closer adherence to your reference

Duration: Determines how many generation steps are guided by your reference.

Experiment with both sliders to find the optimal balance between maintaining your reference's structure and allowing the AI to add creative details based on your prompt.

Step 4: Craft Your Prompt and Generate

1. With your reference set, write a detailed prompt to complement it.

2. Choose a style from Scenario's options.

3. For most cases, the default Sampling Steps value works well. Only adjust if necessary for specific details.

4. Click Generate Preview.

5. Scenario will use your reference to guide the composition while filling in details based on your prompt.

6. Review the low-res previews for a centered horizon, smooth pole transitions, and no seams.

7. Select the best preview and Enhance.

Step 5: Enhance and Export

1. Click Enhance to upscale your chosen preview to a high-res skybox.

2. Refine your prompt if needed.

3. Select a 4x upscale factor for most projects (or 8x for ultra-high-res).

4. Generate the enhanced version.

5. Export the skybox as a high-res image file, ready for game engines.

Practical Examples

Example 1: Fantasy Academy Adventure Game

Process:

1. Sketch mountains and a castle-like structure on a distant hilltop, using green tones for hills, purple and yellow for flowers, and gray for the academy.

2. Set the Reference Type to Image to Image.

3. Adjust the Influence Slider to 10.

4. Use the prompt "A picturesque countryside with rolling hills, vibrant flowers, small villages, and a castle-like academy perched on a distant hill. The landscape is bathed in golden sunlight, with colorful wildflower meadows surrounding the quaint villages."

5. Select the Oil Painting style.

6. Set Sampling Steps to 30 and generate previews.

7. Enhance the best one with a 4x upscale.

Result: A stunning countryside skybox with clearly defined rolling hills matching your sketch's topography, vibrant flower fields adding splashes of color, detailed village buildings, and an impressive academy structure commanding attention on its hilltop, perfect for an open-world RPG or magical academy simulation game.

Example 2: Crystal Cave Explorer Game

Process:

1. Sketch a domed cave interior with crystalline formations along the walls and ceiling, using dark purple tones for the cave and bright colorful lines for the crystals.

2. Set the Reference Type to Depth.

3. Adjust the Influence Slider to 50 and Duration to 60.

4. Use the prompt "Inside a vast, shimmering cave, countless crystals jut out from the walls and ceiling, reflecting a kaleidoscope of colors. The crystalline formations catch the faint light filtering in from above, casting ethereal patterns on the rocky surfaces. A gentle mist hangs in the air, enhancing the otherworldly atmosphere. "

5. Select the Sci-Fi style.

6. Set Sampling Steps to 45 and generate previews.

7. Enhance the best one with a 4x upscale.

Result: A breathtaking cave skybox with accurately positioned crystal formations following your sketch's layout, vibrant color reflections dancing across the rocky surfaces, and atmospheric mist effects that create depth, perfect for an exploration adventure game or puzzle-based crystal mining simulator.