DeformSmith: Physics Harness-Guided Hierarchical Generation of Deformable Assets for Robot Manipulation

The paper presents DeformSmith, a hierarchical agentic framework using a shared physics harness to automatically generate interactive, physically credible deformable assets from text or a single image. The system progressively builds, tests, and refines geometry, physical models, and material behavior until ready for simulation. Results show DeformSmith outperforms current baselines in visual quality and physical plausibility.

DeformSmith generates assets with better visual quality and physical plausibility than state-of-the-art baselines, including PhysGen3D, PhysGM, and PhysX-Omni.