Data-Driven Single Image Deraining: A Comprehensive Review and New Perspectives
preprintposted on 20.07.2021, 20:06 by Zhao Zhang, Yanyan Wei, Haijun Zhang, Yi Yang, Shuicheng Yan, Meng Wang
Abstract—Due to the powerful fitting ability of neural networks and massive training data, data-driven Single Image Deraining (SID) methods have obtained significant performance, and most of the existing studies focus on improving the deraining performance by proposing different kinds of deraining networks. However, the generalization ability of current SID methods may still be limited in the real scenario, and the deraining results also cannot effectively improve the performance of subsequent high-level tasks (such as object detection). The main reason may be because the current works mainly focus on designing new deraining neural networks, while neglecting the interpretation of the solving process. To investigate these issues, we in this paper re-examine the three important factors (i.e.,data, rain model and network architecture) for the SID task, and specifically analyze them by proposing new and more reasonable criteria (i.e., general vs. specific, synthetical vs. mathematical, black-box vs. white-box). We will also study the relationship of the three factors from new perspectives of data, and reveal two different solving paradigms (explicit vs. implicit) for the SID task. Besides, we also profoundly studied one of the three factors, i.e., data, and measured the performance of current methods on different datasets via extensive experiments to reveal the effectiveness of SID data. Finally, with the above comprehensive review and in-depth analysis, we also draw some valuable conclusions and suggestions for future research.