Variable Exposure Images Fusion using Discrete Cosine Transforms

Vivek Ramakrishnan, D. J. Pete

Abstract


Fusing images with different exposure settings are of prime im- portance in the field of computational photography. Both transform domain approach and filtering based approaches are possible for combining multiple exposure images, to obtain the well-exposed image. A Discrete Cosine Trans- form (DCT-based) approach for fusing multiple exposure images has been proposed in this work. The input image stack is processed in the transform domain by an averaging operation and the inverse transform is performed on the averaged image obtained to generate the fusion of multiple exposure image. The experimental observation leads us to the conjecture that the obtained DCT coefficients are indicators of parameters to measure well-exposedness, contrast and saturation as specified in the traditional exposure fusion based approach and the averaging performed indicates equal weights assigned to the DCT coefficients in this non- parametric and non pyramidal approach to fuse the multiple exposure image stack.

Keywords


Discrete, Exposure, Cosine, Fusion, Coefficients, Transform, Contrast, Saturation, Weights.

References


Raman, S. and S. Chaudhuri. “Bilateral Filter Based Compositing for Variable Exposure Pho- tography.” Eurographics (2009).

B. G. Gowri, V. Hariharan, S.Thara, V. Sowmya, S. S. Kumar and K. P. Soman, ”2D Image data approximation using Savitzky Golay filter — Smoothing and differencing,” 2013 Inter- national Mutli-Conference on Automation, Computing, Communication, Control and Com- pressed Sensing (iMac4s), Kottayam, 2013, pp. 365-371, doi: 10.1109/iMac4s.2013.6526438.

T. Porter and T. Duff. Compositing digital images. In ACM Siggraph Computer Graphics, volume 18, pages 253–259 ACM, 1984.

Ramakrishnan, V., Pete, D.J. Non Subsampled Shearlet Transform Based Fusion of Multiple Exposure Images. SN COMPUTER SCIENCE 1, 326 (2020). https://doi.org/10.1007/s42979- 020-00343-4.

Ron Brinkmann. 1999. The art and science of digital compositing. Morgan Kaufmann Pub- lishers Inc., San Francisco, CA, USA.

Thomas Porter and Tom Duff. 1984. Compositing digital images. SIGGRAPH Comput Graph. 18, 3 (July 1984), 253–259. DOI:https://doi.org/10.1145/964965.808606

J. F. Blinn, ”Compositing. 1. Theory,” in IEEE Computer Graphics and Applications, vol. 14, no. 5, pp. 83-87, Sept. 1994, doi: 10.1109/38.310740.

Debevec, and J. Malik. Recovering High Dynamic Range Radiance Maps from Photographs P SIGGRAPH 97 (August 1997).

MANN S., PICARD R. W.: On being undigital with digital cameras: extending dynamic range by combining exposed pictures. In In Proc. of IS & T 48th annual conference (1995), pp. 422–428.

GOSHTASBY A.: Fusion of multi-exposure images. Image and Vision Computing 23 (2005), 611–618.

Y. Chuang, B. Curless, D. H. Salesin, and R. Szeliski. A bayesian approach to digital matting. In CVPR, volume 2, pages 264–271, Kauai Marriott, Hawaii, 2001.

RAMAN S., CHAUDHURI S.: A matte-less, variational approach to automatic scene com- positing. In ICCV (2007).

MERTENS T., KAUTZ J., REETH F. V.: Exposure fusion. In Pacific Graphics (2007).

Y. Guan, W. Chen, X. Liang, Z. Ding, and Q. Peng. Easy matting - a stroke based approach for continuous image matting. Eurographics, 25(3):567–576, 2006.

M. Ruzon and C. Tomasi. Alpha estimation in natural images. In CVPR, volume 1, pages 18–25, Hilton Head Island, South Carolina, USA, 2000.

J. Sun, J. Jia, C. Tang, and H. Shum. Poisson matting. In SIGGRAPH, pages 315–321, Los Angeles, USA, 2004.

J. Wang and M. F. Cohen. An iterative optimization approach for unified image segmentation and matting. In ICCV, pages 936–943, Beijing, China, 2005.

N. Apostoloff and A. Fitzgibbon. Bayesian video matting using learnt image priors. In CVPR, volume 1, pages 407–414, Washington, DC, USA, 2004.

Y. Chuang, A. Agarwala, B. Curless, D. H. Salesin, and R. Szeliski. Video matting of com- plex scenes. In SIGGRAPH, pages 243–248, San Antonio, USA, 2002.

M. McGuire, W. Matusik, H. Pfister, J. F. Hughes, and F. Durand. Defocus video matting. In SIGGRAPH, pages 567–576, Los Angeles, USA, 2005. A. Smith. Alpha and the history of digital compositing. Microsoft Tech Memo 7, 1995.

’Savitzky Golay filter for 2D images’ - http://research.microsoft.com/enus/um/people/jckrumm/SavGol/SavGol. htm, September 2012.

Mantiuk R., Kim K., Rempel A.,Heidrich W. (2011). HDR-VDP-2: A calibrated visual met- ric for visibility and quality predictions in all luminance conditions ACM Trans. Graph.. 30. 40. 10.1145/1964921.1964935.

Bogoni, L.; Hansen, M. Pattern-selective color image fusion. Pattern Recognit. 2001, 34, 1515–1526.

Vonikakis, V.; Bouzos, O.; Andreadis, I. Multi Exposure Image Fusion Based on Illumination Estimation. In Proceedings of the SIPA, Chania, Greece, 22–24 June 2011; pp. 135–142.

Tico, M.; Gelfand, N.; Pulli, K. Motion-Blur-Free Exposure Fusion. In Proceedings of the 2010 IEEE International Conference on Image Processing, Hong Kong, China, 26–29 Septem- ber 2010; pp. 3321–3324.

Jinno, T.; Okuda, M. Multiple Exposure Fusion for High Dynamic Range Image Acquisition. IEEE Trans. Image Process. 2012, 21, 358–365.

Shen, R.; Cheng, I.; Shi, J.; Basu, A. Generalized Random Walks for Fusion of Multi- Exposure Images. IEEE Trans. Image Process. 2011, 20, 3634–3646.

Li, S.; Kang, X. Fast multi-exposure image fusion with median filter and recursive filter. IEEE Trans. Consum. Electron. 2012, 58, 626–632

Mitianoudis, N.; Stathaki, T. Pixel-based and Region-based Image Fusion schemes using ICA bases. Inf. Fusion 2007, 8, 131–142.

Michael Ashikhmin. 2002. A tone mapping algorithm for high contrast images. In Proceed- ings of the 13th Eurographics workshop on Rendering (EGRW ’02). Eurographics Association, Goslar, DEU, 145– 156.

Francesco Banterle, Alessandro Artusi, Elena Sikudova, Thomas Bashford-Rogers, Patrick Ledda, Marina Bloj, and Alan Chalmers. 2012. Dynamic range compression by differential zone mapping based on psychophysical experiments. In Proceedings of the ACM Symposium on Applied Perception (SAP ’12). Association for Computing Machinery, New York, NY, USA, 39–46. DOI:https://doi.org/10.1145/2338676.2338685

Bruce, N.D. (2014). ExpoBlend: Information preserving exposure blending based on nor-malized log-domain entropy. Comput. Graph., 39, 12-23.

Lischinski, D., Farbman, Z., Uyttendaele, M., Szeliski, R. (2006). Interactive local adjust- ment of tonal values. ACM Transactions on Graphics (TOG), 25(3), 646-653.

Tan, J., Huang, Y., Wang, K. (2018, July). Logarithmic Tone Mapping Algorithm Based on Block Mapping Fusion. In 2018 International Conference on Audio, Language and Image Processing (ICALIP) (pp. 168-173). IEEE.

Reinhard, E., Stark, M., Shirley, P., Ferwerda, J. (2002, July). Photographic tone reproduction for digital images. In Proceedings of the 29th annual conference on Computer graphics and interactive techniques (pp. 267-276).

Ramakrishnan, Vivek., Pete, D.. (2021). Savitzky–Golay Filtering-Based Fusion of Mul- tiple Exposure Images for High Dynamic Range Imaging. SN Computer Science. 2. 10.1007/s42979-021-00594-9.

Vivek Ramakrishnan ”Exposure Fusion in the Non-Sub-sampled Contourlet Domain ” Vol. 9 - No. 2 (Feb 2019), International Journal of Engineering Research and Applications (IJERA) ISSN: 2248-9622 , www.ijera.com Last accessed 08 July 2021.

Erik Reinhard, Greg Ward, Sumanta Pattanaik, and Paul Debevec. 2005. High Dynamic Range Imaging: Acquisition, Display, and Image-Based Lighting (The Morgan Kaufmann Se- ries in Computer Graphics). Morgan Kaufmann Publishers Inc., San Francisco, CA, USA.

Lam E. Y. , ”Analysis of the DCT coefficient distributions for document coding,” in IEEE Signal Processing Letters, vol. 11, no. 2, pp. 97-100, Feb. 2004, doi: 10.1109/LSP.2003.821789.

Pratt W. K., Digital Image Processing, New York: Wiley-Interscience, 1978, chapter 10.

Tescher A.G., ”Transform image coding,” in Advances in Electronics and Electron Physics. Suppl. 12. New York: Academic, 1979, pp. 113-115.

Murakami H, Hatori Y., and Yamamoto H., ”Comparison between DPCM and Hadamard transform coding in the composite coding of the NTSC color TV signal,” IEEE Transactions on Communications, vol COM-30, pp. 469-479, Mar. 1982.

Reininger R., and Gibson J. : ”Distribution of the two-dimensional DCT coefficients for images,” IEEE Transactions on Communications 31 (6) 1983.

Weisstein E. W., ”Kolmogorov-Smirnov Test.” From Math World–A Wolfram Web Re- source. http://mathworld.wolfram.com/Kolmogorov- SmimovTest.html, last viewed on March 22, 2010.

Ahmed N., Natarajan T., and Rao K. R., ”Discrete Cosine Transform,” IEEE Transactions on Computers, 90-93, Jan 1974.

Akansu, Ali N. and Haddad, Richard A., Multiresolution Signal Decomposition, Transforms, Subbands, Wavelets, Second Edition, San Diego, CA, Academic Press, 2001.


Full Text: PDF

Refbacks

  • There are currently no refbacks.


Creative Commons License
This work is licensed under a Creative Commons Attribution 3.0 License.

IT in Innovation IT in Business IT in Engineering IT in Health IT in Science IT in Design IT in Fashion

IT in Industry @ http://www.it-in-industry.com . ISSN (Online): 2203-1731; ISSN (Print): 2204-0595