http://iamwilliamli.github.io/tag/robotics/RoboticsWowchemy (https://wowchemy.com)en-usWed, 01 Jul 2026 00:00:00 +0000http://iamwilliamli.github.io/media/icon_hu57a9add8d6f814cad03555fc46bfb714_1053646_512x512_fill_lanczos_center_3.pnghttp://iamwilliamli.github.io/tag/robotics/http://iamwilliamli.github.io/projects/act2see/Wed, 01 Jul 2026 00:00:00 +0000http://iamwilliamli.github.io/projects/act2see/<p>Act2See reconstructs a structured model of an unknown articulated object while a robot is interacting with it. Instead of treating perception and manipulation as separate stages, the system closes the loop between observing the object, choosing an informative action, estimating its joint structure, and updating an explicit URDF representation online.</p> <h2 id="approach">Approach</h2> <p>A vision-language model planner reasons over the current RGB-D observation, the maintained URDF state, the discovered joint list, and the history of previous attempts. It decides whether to probe the object, execute an action, or skip an unhelpful action. The selected interaction is grounded into a grasp and constrained motion, and the resulting end-effector trajectory provides evidence for estimating the object&rsquo;s joint structure.</p> <p>The URDF is both the reconstruction output and structured memory for the planner. Each interaction can therefore improve the representation used to plan the next action.</p> <h2 id="team-and-recognition">Team and recognition</h2> <p>The project is a collaboration with Yifeng Liu, Yuzhen Chen, Bingyang Wang, Jingyi Lu, Han Li, Kaichen Zhou, Mengyu Wang, and Fangneng Zhan. It was accepted to the RSS 2026 FM4RoboPlan Workshop.</p>http://iamwilliamli.github.io/projects/opensun3d_cvpr26/Mon, 01 Jun 2026 00:00:00 +0000http://iamwilliamli.github.io/projects/opensun3d_cvpr26/<p>I collaborated with <a href="https://charlieleee.github.io/" target="_blank" rel="noopener">Chengkun (Charlie) Li</a> on the winning submission for Track 2, Open-Vocabulary 3D Affordance Grounding, at the CVPR 2026 OpenSUN3D Challenge.</p> <h2 id="challenge">Challenge</h2> <p>The track evaluates whether a system can locate and segment the functional part of a 3D indoor scene that enables a language-described action. For example, given an instruction such as opening a refrigerator, the system must ground the request to the relevant interactive element, such as its handle, rather than only recognizing the refrigerator as an object.</p>