Int. Arch. Photogramm. Remote Sens. Spatial Inf. Sci., XL-3/W2, 17-21, 2015
http://www.int-arch-photogramm-remote-sens-spatial-inf-sci.net/XL-3-W2/17/2015/
doi:10.5194/isprsarchives-XL-3-W2-17-2015
© Author(s) 2015. This work is distributed
under the Creative Commons Attribution 3.0 License.
 
10 Mar 2015
CLASSIFICATION ALGORITHMS FOR BIG DATA ANALYSIS, A MAP REDUCE APPROACH
V. A. Ayma1, R. S. Ferreira1, P. Happ1, D. Oliveira1, R. Feitosa1,2, G. Costa1, A. Plaza3, and P. Gamba4 1Dept. of Electrical Engineering, Pontifical Catholic University of Rio de Janeiro, Brazil
2Dept. of Computer and Systems, Rio de Janeiro State University, Brazil
3Dept. of Technology of Computers and Communications, University of Extremadura, Spain
4Dept. of Electronics, University of Pavia, Italy
Keywords: Big Data, MapReduce Framework, Hadoop, Classification Algorithms, Cloud Computing Abstract. Since many years ago, the scientific community is concerned about how to increase the accuracy of different classification methods, and major achievements have been made so far. Besides this issue, the increasing amount of data that is being generated every day by remote sensors raises more challenges to be overcome. In this work, a tool within the scope of InterIMAGE Cloud Platform (ICP), which is an open-source, distributed framework for automatic image interpretation, is presented. The tool, named ICP: Data Mining Package, is able to perform supervised classification procedures on huge amounts of data, usually referred as big data, on a distributed infrastructure using Hadoop MapReduce. The tool has four classification algorithms implemented, taken from WEKA’s machine learning library, namely: Decision Trees, Naïve Bayes, Random Forest and Support Vector Machines (SVM). The results of an experimental analysis using a SVM classifier on data sets of different sizes for different cluster configurations demonstrates the potential of the tool, as well as aspects that affect its performance.
Conference paper (PDF, 852 KB)


Citation: Ayma, V. A., Ferreira, R. S., Happ, P., Oliveira, D., Feitosa, R., Costa, G., Plaza, A., and Gamba, P.: CLASSIFICATION ALGORITHMS FOR BIG DATA ANALYSIS, A MAP REDUCE APPROACH, Int. Arch. Photogramm. Remote Sens. Spatial Inf. Sci., XL-3/W2, 17-21, doi:10.5194/isprsarchives-XL-3-W2-17-2015, 2015.

BibTeX EndNote Reference Manager XML