"S4Net: Single stage salient-instance segmentation" by Ruochen Fan, Ming-Ming Cheng et al.

Article Title

S4Net: Single stage salient-instance segmentation

Authors

Ruochen Fan, BNRist, Tsinghua University, Beijing 100086, China.
Ming-Ming Cheng, Nankai University, Tianjin 300071, China.
Qibin Hou, Nankai University, Tianjin 300071, China.
Tai-Jiang Mu, BNRist, Tsinghua University, Beijing 100086, China.
Jingdong Wang, MSRA, Beijing 100086, China.
Shi-Min Hu, BNRist, Tsinghua University, Beijing 100086, China.

Keywords

salient-instance segmentation, salient object detection, single stage, region-of-interest masking

Abstract

In this paper, we consider salient instance segmentation. As well as producing bounding boxes, our network also outputs high-quality instance-level segments as initial selections to indicate the regions of interest. Taking into account the category-independent property of each target, we design a single stage salient instance segmentation framework, with a novel segmentation branch. Our new branch regards not only local context inside each detection window but also the surrounding context, enabling us to distinguish instances in the same scope even with partial occlusion. Our network is end-to-end trainable and is fast (running at 40 fps for images with resolution 320×320). We evaluate our approach on a publicly available benchmark and show that it outperforms alternative solutions. We also provide a thorough analysis of our design choices to help readers better understand the function of each part of our network. Source code can be found at https://github.com/RuochenFan/S4Net.