Parallel Image Database Processing with Mapreduce and Performance Evaluation in Pseudo Distributed Mode

Muneto Yamamoto ； Kunihiko Kaneko

《International Journal of Electronic Commerce Studies》 3卷2期 (2012/12) Pp. 211-227

https://doi.org/10.7903/ijecs.1092

並列摘要

With recent improvements in camera performance and the spread of low-priced and lightweight video cameras, a large amount of video data is generated, and stored in database form. At the same time, there are limits on what can be done to improve the performance of single computers to make them able to process large-scale information, such as in video analysis. Therefore, an important research topic is how to perform parallel distributed processing of a video database by using the computational resource in a cloud environment. At present, the Apache Hadoop distribution for open-source cloud computing is available from MapReduce. In the present study, we report our results on an evaluation of performance, which remains a problem for video processing in distributed environments, and on parallel experiments using MapReduce on Hadoop.

並列關鍵字

Hadoop ； MapReduce ； Image Processing ； Sequential Image Database

參考文獻

D. Jeffrey, and G. Sanjay, MapReduce: Simplified data processing on large clusters. Paper presented at OSDI'04: Sixth Symposium on Operating System Design and Implementation, San Francisco, USA, December 6-8, 2004.

D. Sudipto, S. Yannis, S.B. Kevin, G. Rainer, J.H. Peter, and M. John, Ricardo: Integrating R and hadoop. Paper presented at the 2010 international conference on Management of data, Indianapolis, USA, June 6-11, 2010.

S. Chris, L. Liu, A. Sean, and L. Jason, HIPI: A hadoop image processing interface for image-based map reduce tasks, B.S. Thesis. University of Virginia, Department of Computer Science, 2011.

W. Keith, C. Andrew, K. Simon, G. Jeff, B. Magdalena, H. Bill, K. YongChul, and B. Yingyi, Astronomical image processing with hadoop. Paper presented at Astronomical Data Analysis Software and Systems XX, Boston, USA, November 7-11, 2010.

H. Chris, and S. Mike, A combined corner and edge detector. Paper presented at the 4th Alvey Vision Conference, Manchester, England, August 31 - September 2, 1988.