Edit-aware RAW Reconstruction

AI in healthcare
Published: arXiv: 2512.05859v1
Authors

Abhijith Punnappurath Luxi Zhao Ke Zhao Hue Nguyen Radek Grzeszczuk Michael S. Brown

Abstract

Users frequently edit camera images post-capture to achieve their preferred photofinishing style. While editing in the RAW domain provides greater accuracy and flexibility, most edits are performed on the camera's display-referred output (e.g., 8-bit sRGB JPEG) since RAW images are rarely stored. Existing RAW reconstruction methods can recover RAW data from sRGB images, but these approaches are typically optimized for pixel-wise RAW reconstruction fidelity and tend to degrade under diverse rendering styles and editing operations. We introduce a plug-and-play, edit-aware loss function that can be integrated into any existing RAW reconstruction framework to make the recovered RAWs more robust to different rendering styles and edits. Our loss formulation incorporates a modular, differentiable image signal processor (ISP) that simulates realistic photofinishing pipelines with tunable parameters. During training, parameters for each ISP module are randomly sampled from carefully designed distributions that model practical variations in real camera processing. The loss is then computed in sRGB space between ground-truth and reconstructed RAWs rendered through this differentiable ISP. Incorporating our loss improves sRGB reconstruction quality by up to 1.5-2 dB PSNR across various editing conditions. Moreover, when applied to metadata-assisted RAW reconstruction methods, our approach enables fine-tuning for target edits, yielding further gains. Since photographic editing is the primary motivation for RAW reconstruction in consumer imaging, our simple yet effective loss function provides a general mechanism for enhancing edit fidelity and rendering flexibility across existing methods.

Paper Summary

Problem
When you take a picture with a camera, it's often not exactly what you want. You might want to adjust the colors, brightness, or contrast to make it look better. This is where editing comes in. However, editing can be tricky, especially if you want to make changes to the original image data (called RAW) rather than just the final output image. Most people edit the final output image (like an 8-bit JPEG) because it's easier to work with, but this can lead to problems when trying to make changes to the original RAW data.
Key Innovation
The researchers have come up with a new way to improve the process of editing camera images. They've developed a "plug-and-play" loss function that can be added to existing image reconstruction methods to make them more robust to different editing styles and operations. This loss function is based on a modular, differentiable image signal processor (ISP) that simulates realistic photofinishing pipelines with tunable parameters. In other words, it's a way to teach computers how to edit images in a more flexible and accurate way.
Practical Impact
This research has the potential to improve the quality of edited images and make it easier for people to edit their photos. By incorporating this new loss function into existing image reconstruction methods, photographers and image editors can expect to see higher-quality sRGB renderings under a wide range of edits. This could be especially useful for applications like photo editing software, where accurate and flexible editing is crucial.
Analogy / Intuitive Explanation
Imagine you're trying to recreate a painting from memory. You might remember the colors, shapes, and textures, but you wouldn't have the exact brushstrokes or details. The researchers' new loss function is like having a guide that helps you recreate the painting by simulating the original brushstrokes and textures. This guide is based on a modular, differentiable ISP that models realistic photofinishing variations, allowing for more accurate and flexible editing.
Paper Information
Categories:
cs.CV
Published Date:

arXiv ID:

2512.05859v1

Quick Actions