  Differentiable physics simulation provides an avenue for tackling previously
intractable challenges through gradient-based optimization, thereby greatly
improving the efficiency of solving robotics-related problems. To apply
differentiable simulation in diverse robotic manipulation scenarios, a key
challenge is to integrate various materials in a unified framework. We present
SoftMAC, a differentiable simulation framework coupling soft bodies with
articulated rigid bodies and clothes. SoftMAC simulates soft bodies with the
continuum-mechanics-based Material Point Method (MPM). We provide a
forecast-based contact model for MPM, which greatly reduces artifacts like
penetration and unnatural rebound. To couple MPM particles with deformable and
non-volumetric clothes meshes, we also propose a penetration tracing algorithm
that reconstructs the signed distance field in local area. Based on simulators
for each modality and the contact model, we develop a differentiable coupling
mechanism to simulate the interactions between soft bodies and the other two
types of materials. Comprehensive experiments are conducted to validate the
effectiveness and accuracy of the proposed differentiable pipeline in
downstream robotic manipulation applications. Supplementary materials and
videos are available on our project website at
https://sites.google.com/view/softmac.
