High-resolution image segmentation is essential in structural health monitoring (SHM), enabling accurate detection and quantification of structural components and damages. However, conventional convolutional neural network-based segmentation methods face limitations in real-world deployment, particularly when handling high-resolution images producing low-resolution outputs. This study introduces a novel framework named Refined-Segment Anything Model (R-SAM) to overcome such challenges. R-SAM leverages the state-of-the-art zero-shot SAM to generate unlabeled segmentation masks, subsequently employing the DEtection Transformer model to label the instances. The key feature and contribution of the R-SAM is its refinement module, which improves the accuracy of masks generated by SAM without the need for extensive data annotations and fine-tuning. The effectiveness of the proposed framework was assessed through qualitative and quantitative analyses across diverse case studies, including multiclass segmentation, simultaneous segmentation and tracking, and 3D reconstruction. The results demonstrate that R-SAM outperforms state-of-the-art convolution neural network-based segmentation models with a mean intersection-over-union of 97% and a mean boundary accuracy of 87%. In addition, achieving high coefficients of determination in target-free tracking case studies highlights its versatility in addressing various challenges in SHM.

中文翻译：

---

基于 Transformer 的框架，用于在结构健康监测中准确分割高分辨率图像


高分辨率图像分割在结构健康监测 （SHM） 中至关重要，能够准确检测和量化结构组件和损伤。然而，传统的基于卷积神经网络的分割方法在实际部署中面临限制，尤其是在处理产生低分辨率输出的高分辨率图像时。本研究引入了一个名为 Refined-Segment Anything Model （R-SAM） 的新框架来克服这些挑战。R-SAM 利用最先进的零样本 SAM 生成未标记的分割掩码，随后采用 DEtection Transformer 模型来标记实例。R-SAM 的主要特点和贡献在于其优化模块，该模块提高了 SAM 生成的掩码的准确性，而无需进行大量的数据注释和微调。通过对不同案例研究的定性和定量分析来评估所提出的框架的有效性，包括多类分割、同步分割和跟踪以及 3D 重建。结果表明，R-SAM 优于最先进的基于卷积神经网络的分割模型，平均交并比为 97%，平均边界准确率为 87%。此外，在无目标跟踪案例研究中实现高决定系数凸显了其在解决 SHM 中各种挑战方面的多功能性。