Projects

Autonomous Surgical Robotics

  • Task planning and VLA-based skill execution for autonomous laparoscopic manipulation.
    • Task-network planning for multi-arm coordination and skill switching.
    • World-model-assisted data augmentation for VLA skills.
    • Constraint monitoring and online recovery during execution.
  • Related prototype: SAFE-Toumai teleoperation. Visual–tactile feedback and assistive motion control.
    • Force estimation from structured-light vision and robot dynamics, with reported error below 0.5 N.
    • Camera–arm coordination under visibility and joint-velocity constraints.
    • Hand-tremor filtering and organ-motion compensation.

Autonomous Exploration & Navigation

  • Autonomous indoor exploration and navigation on a mobile robot.
    • RRT-based frontier exploration.
    • TARE-style hierarchical exploration.
    • Mapping, path tracking with ROS 2 Navigation2, and indoor robot deployment.
RRT exploration on a mobile robot · 0:53
TARE exploration & Navigation2 · 1:32

Data Pipelines and VLN Evaluation

  • Simulation data pipelines and vision-language navigation evaluation.
    • Motion-planning trajectory collection and 3D occupancy data preparation.
    • Automated outdoor scene generation and asset placement in Isaac Sim.
    • Video-to-3D perception benchmarking and SPAN-Nav evaluation on MetaUrban and UrbanSim.
A* + velocity-obstacle navigation in Isaac Sim · 0:11
SPAN-Nav navigation evaluation · 1:10

Fast Task Allocation & Online Replanning

  • Constraint-aware task allocation and online replanning for heterogeneous robot teams.
    • LTL task modeling and partial-order decomposition for parallel execution.
    • Capability, resource, and time-window constraints for synchronized multi-robot tasks.
    • Anytime branch-and-bound search for feasible schedules and shorter makespans within a time budget.
    • Replanning unfinished tasks after agent availability changes or task additions and cancellations.