SCIENTIA SINICA Informationis (SSI) 2023

Distraction-Aware Camouflaged Object Segmentation

Haiyang Mei1     Xin Yang1,*     Yunduo Zhou1     Ge-Peng Ji2     Xiaopeng Wei1     Deng-Ping Fan3    

1 Dalian University of Technology     2 Australian National University     3 Nankai University    

  Contact us:    haiyang.mei@outlook.com    xinyang@dlut.edu.cn




1. Abstract

In this work, our goal is to design an effective and efficient camouflaged object segmentation (COS) model. To this end, we develop a bio-inspired framework, termed pyramid positioning and focus network (PFNet+), which mimics the process of predation in nature. Specifically, our PFNet+ contains three key modules, i.e., a context enrichment (CEn) module, a pyramid positioning module (PPM), and a focus module (FM). The CEn aims at enhancing the representation ability of backbone features via integrating contextual information for providing more discriminative backbone features. The PPM is designed to mimic the detection process in predation for positioning the potential target objects from a global perspective in a pyramid manner and the FM is then used to perform the identification process in predation for progressively refining the initial prediction via focusing on the ambiguous regions. Notably, in the FM, we develop a novel distraction mining strategy for distraction discovery and removal, to benefit the performance of estimation. Extensive experiments demonstrate that our PFNet+ runs in real-time (56 FPS) and outperforms 20 cutting-edge models on three challenging datasets under four standard metrics. The generalization capability of our PFNet+ is further demonstrated by the experiments on the other vision task (i.e., polyp segmentation).

2. Downloads

Paper : [ PFNet_Plus.pdf ]
Experimental results : [ OneDrive ] [ Baidu Disk, fetch code: plus ]
Pre-trained model : [ Google Drive ] [ Baidu Disk, fetch code: plus ]
Code : [ Github ]

3. BibTex

@article{Haiyang:PFNet_Plus:2023,
    author = {Mei, Haiyang and Yang, Xin and Zhou, Yunduo and Ji, Ge-Peng and Wei, Xiaopeng and Fan, Deng-Ping.},
    title = {Distraction-Aware Camouflaged Object Segmentation},
    journal = {SCIENTIA SINICA Informationis (SSI)},
    year = {2023}
}

4. Website Visit Statistics