高级检索

    SAM特征引导的主动学习在缺陷检测中的应用

    Application of Active Learning to Defect Detection Guided by SAM Feature

    • 摘要: 工业缺陷检测(Industrial Defect Detection, IDD)对确保产品质量和生产效率至关重要,但传统方法受限于人工标注的高成本和复杂缺陷模式的识别难题。主动学习通过挑选最有价值的样本进行标注,极大地降低了标注预算,但它仍面临冷启动的问题。文中提出了一种基于“分割一切”模型(Segment Anything Model, SAM)生成的不确定性引导特征加权(SAM-based Uncertainty-guided Feature Weighting, SUGFW)的冷启动主动学习框架,实现低标注成本下的缺陷检测。该框架利用SAM的零样本分割能力,通过区域级不确定性评估和全局特征加权策略,挑选出非常具有代表性和多样性的样本子集进行标注,并采用结合聚类与不确定性信息的样本选择策略,以确保所选样本在特征空间和不确定性区间的均匀分布。在NEU-Seg热轧钢带表面缺陷检测数据集上的实验表明,该框架在3%、10%和20%的标注比例下,平均交并比(Intersection over Union, IoU)均优于现有先进方法至少4个百分点,仅需20%标注预算即可使IoU达到0.8423,接近全标注的0.8599。该框架显著降低了标注成本,为工业缺陷检测提供了高效、鲁棒的解决方案。

       

      Abstract: Industrial defect detection (IDD) is critical for ensuring product quality and production efficiency, yet traditional methods are hindered by the high cost of manual annotation and the challenge of identifying complex defect patterns. Active learning (AL) greatly reduces the annotation budget by selecting the most valuable samples for annotation, but it still faces the issue of cold start. A novel cold start active learning framework, namely SAM-based uncertainty-guided feature weighting (SUGFW) is proposed in this paper to keep low annotation cost for defect detection. Using the zero-shot segmentation capabilities of the segment anything model (SAM), SUGFW employs regional uncertainty estimation and a patch-based global distinct representation (PGDR) strategy to generate highly representative and diverse sample subsets for annotation. Based on a sample selection strategy that combines cluster and uncertainty, SUGFW ensures uniform sample distribution in both feature space and uncertainty intervals. Experiments on the NEU-Seg dataset for hot rolled steel strip surface defect detection demonstrate that SUGFW outperforms the advanced methods at present by 4 percentage points at least in mean intersection over union (IoU) at 3%, 10% and 20% annotation ratios. It has achieved a mean IoU of 0.842 3 under an annotation ratio of 20%, closely approaching the fully annotated performance of 0.859 9. This framework significantly reduces annotation costs and provides an efficient and robust solution for industrial defect detection.

       

    /

    返回文章
    返回