Abstract

Big data is creating hype in IT industry. Knowledge discovery from big data can allow organizations to have deeper insights, look at the bigger picture and project big returns. There are various principles that have been presented for knowledge discovery from big data by ORNL (Oak Ridge National University), USA. These are: (i) support a variety of analysis methods, (ii) one size doesn't fit all, (iii) make data accessible. However timeliness and security still pose great challenges in the knowledge discovery process. Timely analysis of big data is essential because data is being produced at a very high velocity. Security of big data is difficult to ensure since big data solutions were not developed with security in mind. In this paper, we give a view of various big data dimensions and present two new principles based on security and timely analysis for knowledge discovery from big data.

References

• Dijcks, J. P. 2012. Oracle: Big Data for Enterprise. White Paper. Oracle Corporation.
• Begoli, E. and Horey, J. 2012. Design Principles for Effective Knowledge Discovery from Big Data. In Proceedings of the Joint Working IEEE/IFIP Conference on Software Architecture (WICSA) and European Conference on Software Architecture (ECSA).
• Sagiroglu, S. and Sinanc, D. 2013. Big Data: A Review. In Proceedings of the International Conference on Collaboration Technologies and Systems.
• Demchenko, Y. , Grzsso, P. , De Laat, C. , Membrey, P. 2013. Addressing Big Data Issues in Scientific Data Infrastructure. In the proceedings of the International Conference on Collaboration Technologies and Systems.
• Dong, X. L. and Srivastava, D. 2013. Big Data Integration. In the proceedings of the IEEE 29th International Conference on Data Engineering (ICDE).
• Sun, H. and Heller, P. 2012. Enterprise Information Management: Oracle Information Architecture: An Architect's Guide to Big Data. White Paper. Oracle Corporation.
• Dean, J. and Ghemawat, S. MapReduce: Simplifed Data Processing on Large Clusters. http://static. googleusercontent. com/media/research. google. com/en//archive/mapreduce-osdi04. pdf
• Jablonski, J. Introduction to Hadoop. White Paper. Dell
• Big Data Study – The 10 Key Findings. http://sites. tcs. com/big-data-study/big-data-study-key-findings/
• Commercial and Open Source Big Data Platforms Comparison. http://architects. dzone. com/articles/commercial-and open-source-big
• Sato, K. An Inside Look at Google BigQuery. White Paper. Google Inc.
• R Technologies from Oracle. http://www. oracle. com/technetwork/topics/bigdata/r-offerings-1566363. html
• What is Apache Mahout?. https://mahout. apache. org/
• Big Data is a Big Deal. http://www. whitehouse. gov/blog/2012/03/29/big-data-big-deal
• Big Data in Action. http://www-01. ibm. com/software/in/data/bigdata /industry. html
• Zhang, D. 2013. Inconsistencies in Big Data. In the proceedings of the 12th IEEE International Conference on Cognitive Informatics & Cognitive Computing (ICCI&CC).
• Challenges and Opportunities with Big Data. http://www. cra. org/ccc/files/docs/init/bigdatawhitepaper. pdf
• 2013. Reducing the Total Cost of Ownership of Big Data. White Paper. Impetus Technologies Inc.
• Sasirekha, R. NoSQL, the database for the Cloud. White Paper. Tata Consultancy Services Limited.
• Big security for big data. Business White Paper. Hewelett-Packard Development Company.
• The Big Data Security Gap: Protecting the Hadoop Cluster. White Paper. Zettaset. www. zettaset. com/info-center/datasheets/zettaset_wp_security_0413. pdf
• Kindervag, J. , Balaouras, S. , Hill, B. W. , Mak, K. The Future of data Security and Privacy: Controlling Big Data. Technical report. Forrester Research Inc.
• Tankard, C, "Big Data Security", Journal of Network Security, vol. 2012 (Issue 7), July 2012.
• Kim, S. H. , Kim, N. U. , Chung, T. M. 2013. Attribute Relationship Evaluation Methodology for Big Data Security. In the proceedings of the International Conference on IT Convergence and Security (ICITCS).
• Kim, S. H. , Eom, J. H. , Chung, T. M. 2013. Big Data Security Hardening Methodology Using Attributes Relationship. In the proceedings of the International Conference on Information Science and Applications (ICISA).