Comment by nineteen999

Comment by nineteen999 a day ago

5 replies

View on Hacker News

Always love seeing new vt100 implementations! Here's my current pet one running inside Unreal5:

  https://imgur.com/a/2vsGS0G
Vibe coding with Claude in a UE5 Editor tab is a lot of fun ... especially once you give it access to the Remote Control API in UE5, it can control an avatar, take screenshots. All very helpful for debugging 3d games:

  ### Photo Log

  | Filename | Description |
  |----------|-------------|
  | ClaudePOV_20251202_134349_2.png | First 720p test - VT100 terminal visible |
  | ClaudePOV_20251202_143259_4.png | Inside hyperspace tunnel - green rings |
  | ClaudePOV_20251202_143325_5.png | Tunnel with pink/purple shift |
  | ClaudePOV_20251202_143432_6.png | BX-2100 silhouette, purple nebula |
  | ClaudePOV_20251202_143655_7.png | BX-2100 close-up, cockpit visible |
Love Claude. It can build me a Hyperspace GLSL shader in Unreal 5, but it can't get the column headers right in it's screenshot list.
dygd a day ago

Can you explain how Claude interacts with the UE Editor? Does it use the Remove Control API through MCP?

Reply View 3 replies
  • nineteen999 a day ago

    I haven't really looked at MCP because it sounds like it is little bit broken?

    The Remote Control API is just HTTP/JSON so Claude wrote some powershell scripts to query objects from the endpoint.

    We gave Claude a Character Actor in game with an AI controller attached, and it can call functions to the AIController - MovetoXYZ(), Teleport(), TakeScreenshot() etc

    Reply View 2 replies
    • dygd a day ago

      Thank you, that's really cool!

      Reply View 1 reply
      • nineteen999 17 hours ago

        The RC API stuff seems a little bit unstable at the moment (parts of it are alpha and beta), but when it works its handy.

        Reply View 0 replies