Skip to main content

Console

The Console is the natural-language interface to 3DStreet. From the Console panel you can describe what you want in your scene, watch each action stream in as a command pill, and rewind or replay individual edits without losing your place. The Console also doubles as a live history of every editor action — whether you initiated it from a menu, a drag, or a typed command.

Opening the Console​

The Console lives as a tab in the right-hand side panel of the editor, alongside Properties. Click the Console tab to open it. The textarea is auto-focused on activation, so you can start typing immediately and press Enter to send. Use Shift+Enter to insert a newline.

You must be signed in to send commands. If you're not signed in, the Console shows a sign-in prompt overlay.

What you can do​

  • Ask questions about the scene
  • Request modifications (e.g. "Add a row of pedestrians to the sidewalk")
  • Create new streets, models, or other elements
  • Take snapshots from different angles
  • Set the geographic location for the scene
  • Rename the scene

Type /help and press Enter to see a list of example prompts you can click to try.

Command history pills​

Every editor action whether triggered by you, a panel control, or the assistant — streams into the Console as a command pill. Each pill shows:

  • A rewind/redo arrow on the left
  • The command name (e.g. Update, Create, Reparent)
  • The target (e.g. layer name, mixin)
  • A short detail string showing what changed (e.g. position.x: 1.2 → 3.4)

Hover any pill to see the full command details in a tooltip.

Rewinding and replaying​

Click the arrow on a pill to time-travel:

  • If the command is active, clicking undoes back through it (and everything after).
  • If the command is undone (greyed out, line-through), clicking redoes forward through it.

This is the same undo/redo stack as the editor's Cmd/Ctrl+Z shortcut — pills just make it visual and addressable by command.

Resetting the conversation​

Click the circular reset icon in the Console input row to clear the conversation and start fresh. This empties the message log and reinitializes the chat session.

Snapshots and ratings​

When the assistant calls takeSnapshot, the resulting image appears inline in the Console with copy and download actions. After each assistant response, you'll see thumbs-up / thumbs-down buttons — your rating is logged so we can improve the assistant over time.

Example prompts​

  • "Create a two-way street with protected bike lanes"
  • "Take a snapshot of the current view"
  • "Move the car forward 5 meters"
  • "Add bollards to protect the bike lane"
  • "How many drive lanes are in this street?"
  • "Set the location to San Francisco"
  • "Rename the scene to 'Market Street redesign'"

Developer Documentation

Behind the scenes, the Console is powered by Google Gemini (currently gemini-3-flash-preview) via the Vertex AI client. We've found Gemini effective for this use case because it handles large-context tasks well — the system prompt combined with the user's scene graph and other scene data drives up context length quickly.

Console Tools​

The assistant performs actions through tools (function calls). These tools modify the scene, manage streets, capture snapshots, and update scene metadata.

Further Reading​