Robust Guided Image Filtering Using Nonconvex Potentials

Filtering images using a guidance signal, a process called guided or joint image filtering, has been used in various tasks in computer vision and computational photography, particularly for noise reduction and joint upsampling. This uses an additional guidance signal as a structure prior, and transf...

Full description

Bibliographic Details
Published in:IEEE Transactions on Pattern Analysis and Machine Intelligence
Main Authors: Bumsub Ham, Minsu Cho, Jean Poncem
Format: Article in Journal/Newspaper
Language:English
Published: IEEE 2017
Subjects:
Online Access:https://oasis.postech.ac.kr/handle/2014.oak/38353
https://doi.org/10.1109/TPAMI.2017.2669034
_version_ 1821838250418896896
author Bumsub Ham
Minsu Cho
Jean Poncem
author2 Minsu Cho
author_facet Bumsub Ham
Minsu Cho
Jean Poncem
author_sort Bumsub Ham
collection Pohang University of Science and Technology (POSTECH): Open Access System for Information Sharing (OASIS)
container_issue 1
container_start_page 192
container_title IEEE Transactions on Pattern Analysis and Machine Intelligence
container_volume 40
description Filtering images using a guidance signal, a process called guided or joint image filtering, has been used in various tasks in computer vision and computational photography, particularly for noise reduction and joint upsampling. This uses an additional guidance signal as a structure prior, and transfers the structure of the guidance signal to an input image, restoring noisy or altered image structure. The main drawbacks of such a data-dependent framework are that it does not consider structural differences between guidance and input images, and that it is not robust to outliers. We propose a novel SD (for static/dynamic) filter to address these problems in a unified framework, and jointly leverage structural information from guidance and input images. Guided image filtering is formulated as a nonconvex optimization problem, which is solved by the majorize-minimization algorithm. The proposed algorithm converges quickly while guaranteeing a local minimum. The SD filter effectively controls the underlying image structure at different scales, and can handle a variety of types of data from different sensors. It is robust to outliers and other artifacts such as gradient reversal and global intensity shift, and has good edge-preserving smoothing properties. We demonstrate the flexibility and effectiveness of the proposed SD filter in a variety of applications, including depth upsampling, scale-space filtering, texture removal, flash/non-flash denoising, and RGB/NIR denoising. 1 1 0 N scopus
format Article in Journal/Newspaper
genre Arctic
Sea ice
genre_facet Arctic
Sea ice
geographic Arctic
geographic_facet Arctic
id ftponangunivst:oai:oasis.postech.ac.kr:2014.oak/38353
institution Open Polar
language English
op_collection_id ftponangunivst
op_container_end_page 207
op_doi https://doi.org/10.1109/TPAMI.2017.2669034
op_relation IEEE Transactions on Pattern Analysis and Machine Intelligence
Computer Science, Artificial Intelligence
Engineering, Electrical & Electronic
Computer Science
Engineering
0162-8828
https://oasis.postech.ac.kr/handle/2014.oak/38353
doi:10.1109/TPAMI.2017.2669034
26709
IEEE Transactions on Pattern Analysis and Machine Intelligence, v.40, no.1, pp.192 - 207
000417806000015
2-s2.0-85047323698
publishDate 2017
publisher IEEE
record_format openpolar
spelling ftponangunivst:oai:oasis.postech.ac.kr:2014.oak/38353 2025-01-16T20:43:22+00:00 Robust Guided Image Filtering Using Nonconvex Potentials Bumsub Ham Minsu Cho Jean Poncem Minsu Cho 2017-02 https://oasis.postech.ac.kr/handle/2014.oak/38353 https://doi.org/10.1109/TPAMI.2017.2669034 English eng IEEE IEEE Transactions on Pattern Analysis and Machine Intelligence Computer Science, Artificial Intelligence Engineering, Electrical & Electronic Computer Science Engineering 0162-8828 https://oasis.postech.ac.kr/handle/2014.oak/38353 doi:10.1109/TPAMI.2017.2669034 26709 IEEE Transactions on Pattern Analysis and Machine Intelligence, v.40, no.1, pp.192 - 207 000417806000015 2-s2.0-85047323698 ARCTIC SEA-ICE TO-INTERANNUAL PREDICTION SUMMER MONSOON MULTIMODEL ENSEMBLE SOIL-MOISTURE NORTHERN-HEMISPHERE EL-NINO LAND-SURFACE HEAT WAVES WINTER MONSOON Seasonal climate prediction climate variability global climate model Korea and East Asia Article ART 2017 ftponangunivst https://doi.org/10.1109/TPAMI.2017.2669034 2022-10-20T20:23:13Z Filtering images using a guidance signal, a process called guided or joint image filtering, has been used in various tasks in computer vision and computational photography, particularly for noise reduction and joint upsampling. This uses an additional guidance signal as a structure prior, and transfers the structure of the guidance signal to an input image, restoring noisy or altered image structure. The main drawbacks of such a data-dependent framework are that it does not consider structural differences between guidance and input images, and that it is not robust to outliers. We propose a novel SD (for static/dynamic) filter to address these problems in a unified framework, and jointly leverage structural information from guidance and input images. Guided image filtering is formulated as a nonconvex optimization problem, which is solved by the majorize-minimization algorithm. The proposed algorithm converges quickly while guaranteeing a local minimum. The SD filter effectively controls the underlying image structure at different scales, and can handle a variety of types of data from different sensors. It is robust to outliers and other artifacts such as gradient reversal and global intensity shift, and has good edge-preserving smoothing properties. We demonstrate the flexibility and effectiveness of the proposed SD filter in a variety of applications, including depth upsampling, scale-space filtering, texture removal, flash/non-flash denoising, and RGB/NIR denoising. 1 1 0 N scopus Article in Journal/Newspaper Arctic Sea ice Pohang University of Science and Technology (POSTECH): Open Access System for Information Sharing (OASIS) Arctic IEEE Transactions on Pattern Analysis and Machine Intelligence 40 1 192 207
spellingShingle ARCTIC SEA-ICE
TO-INTERANNUAL PREDICTION
SUMMER MONSOON
MULTIMODEL ENSEMBLE
SOIL-MOISTURE
NORTHERN-HEMISPHERE
EL-NINO
LAND-SURFACE
HEAT WAVES
WINTER MONSOON
Seasonal climate prediction
climate variability
global climate model
Korea and East Asia
Bumsub Ham
Minsu Cho
Jean Poncem
Robust Guided Image Filtering Using Nonconvex Potentials
title Robust Guided Image Filtering Using Nonconvex Potentials
title_full Robust Guided Image Filtering Using Nonconvex Potentials
title_fullStr Robust Guided Image Filtering Using Nonconvex Potentials
title_full_unstemmed Robust Guided Image Filtering Using Nonconvex Potentials
title_short Robust Guided Image Filtering Using Nonconvex Potentials
title_sort robust guided image filtering using nonconvex potentials
topic ARCTIC SEA-ICE
TO-INTERANNUAL PREDICTION
SUMMER MONSOON
MULTIMODEL ENSEMBLE
SOIL-MOISTURE
NORTHERN-HEMISPHERE
EL-NINO
LAND-SURFACE
HEAT WAVES
WINTER MONSOON
Seasonal climate prediction
climate variability
global climate model
Korea and East Asia
topic_facet ARCTIC SEA-ICE
TO-INTERANNUAL PREDICTION
SUMMER MONSOON
MULTIMODEL ENSEMBLE
SOIL-MOISTURE
NORTHERN-HEMISPHERE
EL-NINO
LAND-SURFACE
HEAT WAVES
WINTER MONSOON
Seasonal climate prediction
climate variability
global climate model
Korea and East Asia
url https://oasis.postech.ac.kr/handle/2014.oak/38353
https://doi.org/10.1109/TPAMI.2017.2669034