Structured light has proven instrumental in three-dimensional imaging, LiDAR and holographic light projection. Metasurfaces, comprising subwavelength-sized nanostructures, facilitate 180°-field-of-view structured light, circumventing the restricted field of view inherent in traditional optics like diffractive optical elements. However, extant-metasurface-facilitated structured light exhibits sub-optimal performance in downstream tasks, due to heuristic design patterns such as periodic dots that do not consider the objectives of the end application. Here we present 360° structured light, driven by learned metasurfaces. We propose a differentiable framework that encompasses a computationally efficient 180° wave propagation model and a task-specific reconstructor, and exploits both transmission and reflection channels of the metasurface. Leveraging a first-order optimizer within our differentiable framework, we optimize the metasurface design, thereby realizing 360° structured light. We have utilized 360° structured light for holographic light projection and three-dimensional imaging. Specifically, we demonstrate the first 360° light projection of complex patterns, enabled by our propagation model that can be computationally evaluated 50,000× faster than the Rayleigh–Sommerfeld propagation. For three-dimensional imaging, we improve the depth-estimation accuracy by 5.09× in root-mean-square error compared with heuristically designed structured light. Such 360° structured light promises robust 360° imaging and display for robotics, extended-reality systems and human–computer interactions.

结构光已被证明在三维成像、激光雷达和全息光投影中发挥着重要作用。超表面由亚波长尺寸的纳米结构组成，有利于产生 180° 视场结构光，从而规避了衍射光学元件等传统光学器件固有的视场限制。然而，由于启发式设计模式（例如不考虑最终应用目标的周期性点），现有超表面促进的结构光在下游任务中表现出次优性能。在这里，我们展示了由学习的超表面驱动的 360° 结构光。我们提出了一个可微分框架，其中包含计算高效的 180° 波传播模型和特定于任务的重建器，并利用超表面的传输和反射通道。利用可微框架内的一阶优化器，我们优化了超表面设计，从而实现了 360° 结构光。我们利用360°结构光进行全息光投影和三维成像。具体来说，我们展示了第一个复杂图案的 360° 光投影，这是由我们的传播模型实现的，该模型的计算评估速度比瑞利-索末菲传播快 50,000 倍。对于三维成像，与启发式设计的结构光相比，我们将均方根误差的深度估计精度提高了 5.09 倍。这种 360° 结构光可为机器人、扩展现实系统和人机交互提供强大的 360° 成像和显示。