# Controlling the Monty agent live with \`tbp.teleop\`

**URL:** https://forum.thousandbrains.org/t/controlling-the-monty-agent-live-with-tbp-teleop/1151
**Category:** Projects
**Created:** [July 1, 2026, 11:19pm UTC](https://forum.thousandbrains.org/t/controlling-the-monty-agent-live-with-tbp-teleop/1151 "2026-07-01T23:19:23Z")
**Posts on this page:** 1
**Page:** 1

<div class="post-metadata">

### Author: ![rmounir](https://yyz2.discourse-cdn.com/flex034/user_avatar/forum.thousandbrains.org/rmounir/32/268_2.png) [@rmounir](https://forum.thousandbrains.org/u/rmounir)
#### Post date: [July 1, 2026, 11:19pm UTC](https://forum.thousandbrains.org/t/controlling-the-monty-agent-live-with-tbp-teleop/1151/1 "2026-07-01T23:19:23Z")

</div>

Hi everyone!

Sharing another companion tool for Monty: `tbp.teleop`. It lets you watch a training or inference experiment run live, and if you want, take over and drive the sensor around the object yourself.

![teleop](https://canada1.discourse-cdn.com/flex034/uploads/thousandbrains/original/2X/3/35ae854fab43ef0577687307d2952dff87014ce8.gif)

`tbp.plot` is for visualizing the logs after a run. This one is for watching the run happen live and controlling the agent actions. It is attached as an experiment step hook. Two hooks are provided as a Hydra hooks config group:

- `monitor`: just watch and set the experiment speed.
- `interactive`: watch and teleoperate, choosing the agent’s action at each step.

Add one to your experiment’s defaults (`/hooks: [monitor|interactive]`), or pick it at run time as a Hydra override:

```zsh
  python run.py -cd src/tbp/teleop/conf experiment=example +hooks=interactive
  # or +hooks=monitor

```

In monitor mode there’s a speed slider. In interactive mode you get a little D-pad around the patch instead (WASD or arrow keys for the four headings, space to jump when the model offers one, delete to end the episode), plus a slider to control the action step size.

Repo: [GitHub - thousandbrainsproject/tbp.teleop: Visualize and teleoperate a Monty experiment in real-time · GitHub](https://github.com/thousandbrainsproject/tbp.teleop)

Give it a try and let me know what you think. Ideas for improvements and PRs are very welcome!
