Bayesian-Network-Based Algorithm Selection with High Level Representation Feedback for Real-World Intelligent Systems

martin lukac, Michitaka Kameyama


A real-world intelligent system consists of three basic modules: environment recognition, prediction (or estimation), and behavior planning. To obtain high quality results in these modules, high speed processing and real time adaptability on a case by case basis are required. In the environment recognition module many different algorithms and algorithm networks exist with varying performance. Thus, a mechanism that selects the best possible algorithm is required. To solve this problem we are using an algorithm selection approach to the problem of natural image understanding. This selection mechanism is based on machine learning; a bottom-up algorithm selection from real-world image features and a top-down algorithm selection using information obtained from a high level symbolic world description and algorithm suitability. The algorithm selection method iterates for each input image until the high-level description cannot be improved anymore. In this paper we present a method of iterative composition of the high level description. This step by step approach allows us to select the best result for each region of the image by evaluating all the intermediary representations and finally keep only the best one.


Natural Image Processing; Algorithm Selection; High Level Representation; Adaptive Rewriting


J. R. Rice, “The algorithm selection problem,” Advances in Computers, vol. 15, pp. 65-118, 1976.

X. Yong, D. Feng, and Z. Rongchun, “Optimal selection of image segmentation algorithms based on performance prediction,” in Proceedings of the Pan-Sydney Area Workshop on Visual Information Processing (VIP2003), 2003.

S. Takemoto and H. Yokota, "Algorithm selection for intracellular image segmentation based on region similarity," in Proceedings of the 9th International Conference on Intelligent Systems Design and Applications, 2009.

M. Lukac, R. Tanizawa, and M. Kameyama, "Machine learning based adaptive contour detection using algorithm selection and image splitting," Interdisciplinary Information Sciences, vol. 18, no. 2, pp. 123-134, 2012.

M. Lukac, M. Kameyama, and K. Hiura, "Natural image understanding using algorithm selection and high level feedback," in Proceedings of the SPIE, Intelligent Robots and Computer Vision XXX: Algorithms and Techniques, 2013.

M. Lukac, M. Kameyama, and Y. Fujioka, "VLSI platform for real-world intelligent integrated systems based on algorithm selection," in IADIS TPMC, 2013.

J. Malik, S. Belongie, J. Shi, and T. Leung, "Textons, contours and regions: Cue combination in image segmentation," in Proceedings of the International Conference on Computer Vision, 1999.

M. Maire, P. Arbelaez, C. Fowlkes, and J. Malik, "Using contours to detect and localize junctions in natural images," in Proceedings of the IEEE Conference on vision and Pattern Recognition, CVPR, 2008.

J. Shi and J. Malik, "Normalized cuts and image segmentation," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 22, no. 8, pp. 888-905, 2000.

M. Donoser, M. Urschler, and H. Bischof, "Saliency driven total variational segmentation," in Proceedings of the 12th International Conference on Computer Vision, IEEE, 2009, pp. 817-824.

J. Carreira, F. Li, and C. Sminchisescu, "Object recognition by sequential figure-ground ranking," International Journal of Computer Vision, vol. 98, no. 3, pp. 243-262, 2012.

P. Felzenszwalb, R. Girshick, D. McAllester, and D. Ramanan, "Object detection with discriminatively trained part based models," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 32, no. 9, pp. 1627-1645, 2010.

L. Ladicky, C. Russell, P. Kohli, and P.H.S. Torr, "Graph cut based inference with co-occurrence statistics," in Proceedings of the 11th European Conference on Computer Vision, ECCV'10, 2010, pp. 239-253.

L. Ladicky, P. Sturgess, K. Alahari, C. Russell, and P. H. S. Torr, "What, where and how many? combining object detectors and crfs," in Proceedings of the 11th European Conference on Computer Vision, ECCV'10, 2010. pp. 424-437.

A. Ion, J. Carreira, and C. Sminchisescu, "Probabilistic joint image segmentation and labeling," in Proceedings of the Conference Neural Information Processing Systems, 2011, pp. 1827-1835.

M. Martin, C. Fowlkes, D. Tal, and J. Malik, "A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics," in Proceedings of the 8th International Conference on Computer Vision, July 2001, vol. 2, pp. 416-423.

A. Oliva and A. Torralba, "Modeling the shape of the scene: a holistic representation of the spatial envelope," International Journal of Computer Vision, vol. 42, no. 3, pp. 145-175, 2001.

Full Text: PDF


  • There are currently no refbacks.

Creative Commons License
This work is licensed under a Creative Commons Attribution 3.0 License.

IT in Innovation IT in Business IT in Engineering IT in Health IT in Science IT in Design IT in Fashion

IT in Industry ISSN (Online): 2203-1731; ISSN (Print): 2204-0595