# 2026/07 - Robotic Object Recognition for Thousand Brains Systems **URL:** \ **Category:** Video Discussions\ **Tags:** brainstorming-video\ **Created:** [August 4, 2026, 2:42pm UTC](https://forum.thousandbrains.org/t/2026-07-robotic-object-recognition-for-thousand-brains-systems/1173 "2026-08-04T14:42:56Z")\ **Posts on this page:** 8\ **Page:** 1
**Author:** ![TBP-Announcements](https://yyz2.discourse-cdn.com/flex034/user_avatar/forum.thousandbrains.org/tbp-announcements/32/1065_2.png) [@TBP-Announcements](https://forum.thousandbrains.org/u/TBP-Announcements)\ **Post date:** [August 4, 2026, 2:42pm UTC](https://forum.thousandbrains.org/t/2026-07-robotic-object-recognition-for-thousand-brains-systems/1173/1 "2026-08-04T14:42:56Z")
Special guest @Zachary_Danzig shares his undergraduate thesis with the team. Zachary’s hard work brought Monty onto real robotic hardware. His project combined a stereo camera (to act as a distant agent), a time-of-flight depth sensor and a UFactory Lite 6 robotic arm (to act as a surface agent) to explore how multiple sensing modalities can work in the real world for learning and object recognition in Monty. Zachary’s proof-of-concept thesis lays the foundation for future robotics research with Monty. # Main Video [![](https://canada1.discourse-cdn.com/flex034/uploads/thousandbrains/original/2X/9/9a910b833bd6d28ebd26aba8e1c0d33dc5ad4410.jpeg "07/2026 - Robotic Object Recognition for Thousand Brains Systems") ](https://www.youtube.com/watch?v=3wgHNqkRekM) If you want to follow Zachary’s journey putting this project together, you can retrace his footsteps on the forum: [https://forum.thousandbrains.org/t/de…](https://www.youtube.com/redirect?event=video_description&redir_token=QUM4Zm9rUng4U0xQeFhmbHJuMWlfYTlYNnBnN3xBR3JiS2FuRUs1cUZ6TGRCWlVobWZHOXJBMlN1azdMcGdVbG92c1dmQ0gwRkExR2lWQjdHM25SczktendaeGtWeEE3MGIwOVBXM0tJSkE5MzJsUlBZX3lWaWUxUmlnZTVJRm5f&q=https%3A%2F%2Fforum.thousandbrains.org%2Ft%2Fdesign-of-final-year-undergraduate-project-with-the-inclusion-of-the-tbp%2F417&v=-CJJ5q1cf-o) [0:00](https://www.youtube.com/watch?v=3wgHNqkRekM) Introduction [0:08](https://www.youtube.com/watch?v=3wgHNqkRekM&t=8s) Introducting Zachary Danzig [1:15](https://www.youtube.com/watch?v=3wgHNqkRekM&t=75s) Robotic Object Recognition for Thousand-Brains Systems [1:49](https://www.youtube.com/watch?v=3wgHNqkRekM&t=109s) Background: Discovering the Thousand Brains Theory [3:57](https://www.youtube.com/watch?v=3wgHNqkRekM&t=237s) Project Aim and Objectives [4:38](https://www.youtube.com/watch?v=3wgHNqkRekM&t=278s) Project Timeline [5:11](https://www.youtube.com/watch?v=3wgHNqkRekM&t=311s) Monty Meets World Proof of Concept: iPad LiDAR [6:04](https://www.youtube.com/watch?v=3wgHNqkRekM&t=364s) Background Research [7:25](https://www.youtube.com/watch?v=3wgHNqkRekM&t=445s) Sensor Research [8:09](https://www.youtube.com/watch?v=3wgHNqkRekM&t=489s) A Dual-Agent Project Approach [9:09](https://www.youtube.com/watch?v=3wgHNqkRekM&t=549s) Sensorimotor System Flowchart [10:09](https://www.youtube.com/watch?v=3wgHNqkRekM&t=609s) Distant Agent Setup [11:05](https://www.youtube.com/watch?v=3wgHNqkRekM&t=665s) Surface Agent Setup [12:16](https://www.youtube.com/watch?v=3wgHNqkRekM&t=736s) Translating Abstract Goals to Robot Motion [14:39](https://www.youtube.com/watch?v=3wgHNqkRekM&t=879s) Running through the Experiment [16:39](https://www.youtube.com/watch?v=3wgHNqkRekM&t=999s) Filtering Time of Flight Data [17:17](https://www.youtube.com/watch?v=3wgHNqkRekM&t=1037s) Reference Frames [18:15](https://www.youtube.com/watch?v=3wgHNqkRekM&t=1095s) The Dataset [18:55](https://www.youtube.com/watch?v=3wgHNqkRekM&t=1135s) Distant Agent Experiments [21:16](https://www.youtube.com/watch?v=3wgHNqkRekM&t=1276s) Demoing a Distant Agent Experiment [22:08](https://www.youtube.com/watch?v=3wgHNqkRekM&t=1328s) Distant Agent Results (Supervised Training Evaluation) [22:24](https://www.youtube.com/watch?v=3wgHNqkRekM&t=1344s) Distant Agent Results (Rotation Invariance Experiment) [24:44](https://www.youtube.com/watch?v=3wgHNqkRekM&t=1484s) Distant Agent Results (Continual Learning Experiment) [27:52](https://www.youtube.com/watch?v=3wgHNqkRekM&t=1672s) Surface Agent Demo [28:18](https://www.youtube.com/watch?v=3wgHNqkRekM&t=1698s) Surface Agent Results (The Hardware Reality) [29:08](https://www.youtube.com/watch?v=3wgHNqkRekM&t=1748s) Challenges Faced: Time of Flight Sensor Scattering [30:07](https://www.youtube.com/watch?v=3wgHNqkRekM&t=1807s) Challenges Faced: Interfacing with the Lower-Level Workings of Monty [30:39](https://www.youtube.com/watch?v=3wgHNqkRekM&t=1839s) Challenges Faced: Working with a Changing Codebase [31:43](https://www.youtube.com/watch?v=3wgHNqkRekM&t=1903s) Tips for Future Community Projects [33:29](https://www.youtube.com/watch?v=3wgHNqkRekM&t=2009s) Extensions to the Project [38:09](https://www.youtube.com/watch?v=3wgHNqkRekM&t=2289s) What I Would Do With More Time [39:38](https://www.youtube.com/watch?v=3wgHNqkRekM&t=2378s) Q&A: Tactile Sensors Discussion [44:49](https://www.youtube.com/watch?v=3wgHNqkRekM&t=2689s) Q&A: Safety Features and Motor Constraints [53:47](https://www.youtube.com/watch?v=3wgHNqkRekM&t=3227s) Thank you Zach! ---
**Author:** ![Zachary\_Danzig](https://yyz2.discourse-cdn.com/flex034/user_avatar/forum.thousandbrains.org/zachary_danzig/32/808_2.png) [@Zachary\_Danzig](https://forum.thousandbrains.org/u/Zachary_Danzig)\ **Post date:** [August 5, 2026, 11:38am UTC](https://forum.thousandbrains.org/t/2026-07-robotic-object-recognition-for-thousand-brains-systems/1173/2 "2026-08-05T11:38:58Z")
Many thanks for having me on to present! 😁 ---
**Author:** ![Alex](https://yyz2.discourse-cdn.com/flex034/user_avatar/forum.thousandbrains.org/alex/32/1353_2.png) [@Alex](https://forum.thousandbrains.org/u/Alex)\ **Post date:** [August 6, 2026, 11:58am UTC](https://forum.thousandbrains.org/t/2026-07-robotic-object-recognition-for-thousand-brains-systems/1173/3 "2026-08-06T11:58:07Z")
Thanks for the interesting presentation. Just on tactile sensors (a favourite subject of mine), there doesn’t appear to be any viable technology out there. The GelSight technique may work for small patches but it won’t scale to large areas. Touch is the third of the big three senses and it will be difficult for any robot to function in the real world without it. A robot will require a touch sensitive skin covering its entire surface. If it could be temperature and moisture sensitive as well that would be good. And self-repairing. Today’s humanoid robots most likely just have tactile sensors on their finger tips and nothing more. An artificial skin will need to be a tough, flexible pressure sensitive membrane with the pressure data muxed onto a communications bus running around the robot body. Arrays of tiny magnets and hall effect sensors may be feasible, or some kind of pressure sensitive resistor material. ---
**Author:** ![Zachary\_Danzig](https://yyz2.discourse-cdn.com/flex034/user_avatar/forum.thousandbrains.org/zachary_danzig/32/808_2.png) [@Zachary\_Danzig](https://forum.thousandbrains.org/u/Zachary_Danzig)\ **Post date:** [August 28, 2026, 10:32am UTC](https://forum.thousandbrains.org/t/2026-07-robotic-object-recognition-for-thousand-brains-systems/1173/4 "2026-08-28T10:32:28Z")
Thanks Alex! I was very interested in the homemade tactile sensor you shared with me at the end of last year. I very much agree with the sense that there is much more progress to be made in tactile sensing, and the technology is nowhere near the biological equivalent today! Looking forward to the next breakthrough in this field as it will bring many new opportunities for robotics! ---
**Author:** ![Alex](https://yyz2.discourse-cdn.com/flex034/user_avatar/forum.thousandbrains.org/alex/32/1353_2.png) [@Alex](https://forum.thousandbrains.org/u/Alex)\ **Post date:** [August 28, 2026, 5:12pm UTC](https://forum.thousandbrains.org/t/2026-07-robotic-object-recognition-for-thousand-brains-systems/1173/5 "2026-08-28T17:12:06Z")
Hi @Zachary_Danzig , following on from the hall effect sensors discussed in another thread I have discovered that you can buy 2mm diameter magnets very cheaply and SOT-23 packaged Hall Effect sensors. So it would be possible to make a pressure sensor array with 3 or 4mm resolution reasonably cheaply. If built on flexi-pcb material it could even wrap around things, so making sensitive hands and feet is doable. If I had the time a would like to trying building one.Then comes the problem of how to handle the sensor data 🙂 ---
**Author:** ![Zachary\_Danzig](https://yyz2.discourse-cdn.com/flex034/user_avatar/forum.thousandbrains.org/zachary_danzig/32/808_2.png) [@Zachary\_Danzig](https://forum.thousandbrains.org/u/Zachary_Danzig)\ **Post date:** [August 28, 2026, 6:11pm UTC](https://forum.thousandbrains.org/t/2026-07-robotic-object-recognition-for-thousand-brains-systems/1173/6 "2026-08-28T18:11:06Z")
Definitely sounds like something that could be used by Monty. 3/4mm precision is pretty reasonable for learning the surface of an object. Let me know if you ever attempt this project because I’d be interested to see the outcome! ---
**Author:** ![W\_Foxalike](https://yyz2.discourse-cdn.com/flex034/user_avatar/forum.thousandbrains.org/w_foxalike/32/1432_2.png) [@W\_Foxalike](https://forum.thousandbrains.org/u/W_Foxalike)\ **Post date:** [August 30, 2026, 1:19pm UTC](https://forum.thousandbrains.org/t/2026-07-robotic-object-recognition-for-thousand-brains-systems/1173/7 "2026-08-30T13:19:18Z")
It’s really inspiring to see Monty running on real robotic hardware — this is a direction I’m very interested in too. One idea I keep coming back to: instead of moving the sensor over the object, could the arm hold the object and turn it in front of a fixed depth camera? The sensor-to-object pose would then come from the arm’s kinematics. It’s also closer to how we get to know a new object ourselves — we pick it up and turn it around, but we only have one pair of eyes. ---
**Author:** ![Alex](https://yyz2.discourse-cdn.com/flex034/user_avatar/forum.thousandbrains.org/alex/32/1353_2.png) [@Alex](https://forum.thousandbrains.org/u/Alex)\ **Post date:** [September 1, 2026, 1:01pm UTC](https://forum.thousandbrains.org/t/2026-07-robotic-object-recognition-for-thousand-brains-systems/1173/8 "2026-09-01T13:01:58Z")
Hi @Zachary_Danzig, got this design in my head now and can’t stop thinking about how to build it. I’m thinking of an 8 x 8 array of sensors which would be about 3 cm x 3cm square. The magnets would be encapsulated in a 3D printed rubbery sheet placed over the SOT-23 packaged hall effect sensors. On the back of the PCB would be the analogue to digital conversion and interface electronics. If you were to connect it to Monty what would the interface be? a USB serial port perhaps, generating a stream of 64 8-bit pressure values 50 times per second for example. Other array layouts could be possible, concentric circles maybe, but I’m not sure if anything is gained by that. The concept of ‘sharp’ would be a few sensors having strong signals while the others have weak signals when pressing. ‘Hard’ and ‘soft’ would be the ratio between pressure signals and end effector motion against the surface. In other words, on a soft surface the surface gives so the end effector can move further and pressure signals are small, while ‘hard’ is small end effector motion and high pressure signals. There is a large temporal element to touch sensor data, which I believe Monty has limited support for at present?