Robust Guided Image Filtering Using Nonconvex Potentials
Filtering images using a guidance signal, a process called guided or joint image filtering, has been used in various tasks in computer vision and computational photography, particularly for noise reduction and joint upsampling. This uses an additional guidance signal as a structure prior, and transf...
Published in: | IEEE Transactions on Pattern Analysis and Machine Intelligence |
---|---|
Main Authors: | , , |
Format: | Article in Journal/Newspaper |
Language: | English |
Published: |
IEEE
2017
|
Subjects: | |
Online Access: | https://oasis.postech.ac.kr/handle/2014.oak/38353 https://doi.org/10.1109/TPAMI.2017.2669034 |
_version_ | 1821838250418896896 |
---|---|
author | Bumsub Ham Minsu Cho Jean Poncem |
author2 | Minsu Cho |
author_facet | Bumsub Ham Minsu Cho Jean Poncem |
author_sort | Bumsub Ham |
collection | Pohang University of Science and Technology (POSTECH): Open Access System for Information Sharing (OASIS) |
container_issue | 1 |
container_start_page | 192 |
container_title | IEEE Transactions on Pattern Analysis and Machine Intelligence |
container_volume | 40 |
description | Filtering images using a guidance signal, a process called guided or joint image filtering, has been used in various tasks in computer vision and computational photography, particularly for noise reduction and joint upsampling. This uses an additional guidance signal as a structure prior, and transfers the structure of the guidance signal to an input image, restoring noisy or altered image structure. The main drawbacks of such a data-dependent framework are that it does not consider structural differences between guidance and input images, and that it is not robust to outliers. We propose a novel SD (for static/dynamic) filter to address these problems in a unified framework, and jointly leverage structural information from guidance and input images. Guided image filtering is formulated as a nonconvex optimization problem, which is solved by the majorize-minimization algorithm. The proposed algorithm converges quickly while guaranteeing a local minimum. The SD filter effectively controls the underlying image structure at different scales, and can handle a variety of types of data from different sensors. It is robust to outliers and other artifacts such as gradient reversal and global intensity shift, and has good edge-preserving smoothing properties. We demonstrate the flexibility and effectiveness of the proposed SD filter in a variety of applications, including depth upsampling, scale-space filtering, texture removal, flash/non-flash denoising, and RGB/NIR denoising. 1 1 0 N scopus |
format | Article in Journal/Newspaper |
genre | Arctic Sea ice |
genre_facet | Arctic Sea ice |
geographic | Arctic |
geographic_facet | Arctic |
id | ftponangunivst:oai:oasis.postech.ac.kr:2014.oak/38353 |
institution | Open Polar |
language | English |
op_collection_id | ftponangunivst |
op_container_end_page | 207 |
op_doi | https://doi.org/10.1109/TPAMI.2017.2669034 |
op_relation | IEEE Transactions on Pattern Analysis and Machine Intelligence Computer Science, Artificial Intelligence Engineering, Electrical & Electronic Computer Science Engineering 0162-8828 https://oasis.postech.ac.kr/handle/2014.oak/38353 doi:10.1109/TPAMI.2017.2669034 26709 IEEE Transactions on Pattern Analysis and Machine Intelligence, v.40, no.1, pp.192 - 207 000417806000015 2-s2.0-85047323698 |
publishDate | 2017 |
publisher | IEEE |
record_format | openpolar |
spelling | ftponangunivst:oai:oasis.postech.ac.kr:2014.oak/38353 2025-01-16T20:43:22+00:00 Robust Guided Image Filtering Using Nonconvex Potentials Bumsub Ham Minsu Cho Jean Poncem Minsu Cho 2017-02 https://oasis.postech.ac.kr/handle/2014.oak/38353 https://doi.org/10.1109/TPAMI.2017.2669034 English eng IEEE IEEE Transactions on Pattern Analysis and Machine Intelligence Computer Science, Artificial Intelligence Engineering, Electrical & Electronic Computer Science Engineering 0162-8828 https://oasis.postech.ac.kr/handle/2014.oak/38353 doi:10.1109/TPAMI.2017.2669034 26709 IEEE Transactions on Pattern Analysis and Machine Intelligence, v.40, no.1, pp.192 - 207 000417806000015 2-s2.0-85047323698 ARCTIC SEA-ICE TO-INTERANNUAL PREDICTION SUMMER MONSOON MULTIMODEL ENSEMBLE SOIL-MOISTURE NORTHERN-HEMISPHERE EL-NINO LAND-SURFACE HEAT WAVES WINTER MONSOON Seasonal climate prediction climate variability global climate model Korea and East Asia Article ART 2017 ftponangunivst https://doi.org/10.1109/TPAMI.2017.2669034 2022-10-20T20:23:13Z Filtering images using a guidance signal, a process called guided or joint image filtering, has been used in various tasks in computer vision and computational photography, particularly for noise reduction and joint upsampling. This uses an additional guidance signal as a structure prior, and transfers the structure of the guidance signal to an input image, restoring noisy or altered image structure. The main drawbacks of such a data-dependent framework are that it does not consider structural differences between guidance and input images, and that it is not robust to outliers. We propose a novel SD (for static/dynamic) filter to address these problems in a unified framework, and jointly leverage structural information from guidance and input images. Guided image filtering is formulated as a nonconvex optimization problem, which is solved by the majorize-minimization algorithm. The proposed algorithm converges quickly while guaranteeing a local minimum. The SD filter effectively controls the underlying image structure at different scales, and can handle a variety of types of data from different sensors. It is robust to outliers and other artifacts such as gradient reversal and global intensity shift, and has good edge-preserving smoothing properties. We demonstrate the flexibility and effectiveness of the proposed SD filter in a variety of applications, including depth upsampling, scale-space filtering, texture removal, flash/non-flash denoising, and RGB/NIR denoising. 1 1 0 N scopus Article in Journal/Newspaper Arctic Sea ice Pohang University of Science and Technology (POSTECH): Open Access System for Information Sharing (OASIS) Arctic IEEE Transactions on Pattern Analysis and Machine Intelligence 40 1 192 207 |
spellingShingle | ARCTIC SEA-ICE TO-INTERANNUAL PREDICTION SUMMER MONSOON MULTIMODEL ENSEMBLE SOIL-MOISTURE NORTHERN-HEMISPHERE EL-NINO LAND-SURFACE HEAT WAVES WINTER MONSOON Seasonal climate prediction climate variability global climate model Korea and East Asia Bumsub Ham Minsu Cho Jean Poncem Robust Guided Image Filtering Using Nonconvex Potentials |
title | Robust Guided Image Filtering Using Nonconvex Potentials |
title_full | Robust Guided Image Filtering Using Nonconvex Potentials |
title_fullStr | Robust Guided Image Filtering Using Nonconvex Potentials |
title_full_unstemmed | Robust Guided Image Filtering Using Nonconvex Potentials |
title_short | Robust Guided Image Filtering Using Nonconvex Potentials |
title_sort | robust guided image filtering using nonconvex potentials |
topic | ARCTIC SEA-ICE TO-INTERANNUAL PREDICTION SUMMER MONSOON MULTIMODEL ENSEMBLE SOIL-MOISTURE NORTHERN-HEMISPHERE EL-NINO LAND-SURFACE HEAT WAVES WINTER MONSOON Seasonal climate prediction climate variability global climate model Korea and East Asia |
topic_facet | ARCTIC SEA-ICE TO-INTERANNUAL PREDICTION SUMMER MONSOON MULTIMODEL ENSEMBLE SOIL-MOISTURE NORTHERN-HEMISPHERE EL-NINO LAND-SURFACE HEAT WAVES WINTER MONSOON Seasonal climate prediction climate variability global climate model Korea and East Asia |
url | https://oasis.postech.ac.kr/handle/2014.oak/38353 https://doi.org/10.1109/TPAMI.2017.2669034 |