  We introduce the problem of knot-based inverse perceptual art. Given multiple
target images and their corresponding viewing configurations, the objective is
to find a 3D knot-based tubular structure whose appearance resembles the target
images when viewed from the specified viewing configurations. To solve this
problem, we first design a differentiable rendering algorithm for rendering
tubular knots embedded in 3D for arbitrary perspective camera configurations.
Utilizing this differentiable rendering algorithm, we search over the space of
knot configurations to find the ideal knot embedding. We represent the knot
embeddings via homeomorphisms of the desired template knot, where the
homeomorphisms are parametrized by the weights of an invertible neural network.
Our approach is fully differentiable, making it possible to find the ideal 3D
tubular structure for the desired perceptual art using gradient-based
optimization. We propose several loss functions that impose additional physical
constraints, enforcing that the tube is free of self-intersection, lies within
a predefined region in space, satisfies the physical bending limits of the tube
material and the material cost is within a specified budget. We demonstrate
through results that our knot representation is highly expressive and gives
impressive results even for challenging target images in both single view as
well as multiple view constraints. Through extensive ablation study we show
that each of the proposed loss function is effective in ensuring physical
realizability. We construct a real world 3D-printed object to demonstrate the
practical utility of our approach. To the best of our knowledge, we are the
first to propose a fully differentiable optimization framework for knot-based
inverse perceptual art.
