Abstract | ||
---|---|---|
We propose a trainable Image Signal Processing (ISP) framework that produces DSLR quality images given RAW images captured by a smartphone. To address the color misalignments between training image pairs, we employ a color-conditional ISP network and optimize a novel parametric color mapping between each input RAW and reference DSLR image. During inference, we predict the target color image by designing a color prediction network with efficient Global Context Transformer modules. The latter effectively leverage global information to learn consistent color and tone mappings. We further propose a robust masked aligned loss to identify and discard regions with inaccurate motion estimation during training. Lastly, we introduce the ISP in the Wild (ISPW) dataset, consisting of weakly paired phone RAW and DSLR sRGB images. We extensively evaluate our method, setting a new state-of-the-art on two datasets. The code is available at
https://github.com/4rdhendu/TransformPhone2DSLR
. |
Year | DOI | Venue |
---|---|---|
2022 | 10.1007/978-3-031-20068-7_36 | Computer Vision – ECCV 2022 |
Keywords | DocType | ISSN |
Color conditional ISP, Efficient global attention, Learning in the wild, Mate30Canon dataset | Conference | 0302-9743 |
Citations | PageRank | References |
0 | 0.34 | 0 |
Authors | ||
5 |
Name | Order | Citations | PageRank |
---|---|---|---|
Ardhendu Shekhar Tripathi | 1 | 1 | 1.36 |
Danelljan Martin | 2 | 1344 | 49.35 |
Samarth Shukla | 3 | 0 | 0.34 |
Radu Timofte | 4 | 1880 | 118.45 |
Luc Van Gool | 5 | 0 | 3.38 |