Implementation of Cloud Storage System using Multiple Cloud Services

Transcription

1 Implementation of Cloud Storage System using Multiple Cloud Services Sarang Mandloi 1, Priya Saxena 2 1 Research Scholar, Department of Computer Science & Engg., Sanghvi Innovative Academy, Indore, M.P, India 2 Assistant Professor, Sanghvi Innovative Academy, Indore, M.P, India Abstract With rapid development of cloud computing, data storage space requirements from end-users are increasing, demanding additional capacity, extra reliability and the capacity to access information from everywhere. Storage layer is the most basic part of the cloud storage. Cloud-based storage management is the core part is stored in the cloud part of the most difficult to achieve. In this paper we describe an efficient cloud storage model for heterogeneous cloud services. Keywords computing, cloud storage, cloud services. I. INTRODUCTION Cloud computing has grown an adoptable technology for many of the organizations which consists of dynamic scalability and entry to virtualized resources being a service with the Internet [1]. Impair computing, as an emerging calculating paradigm, enables customers to remotely shop their data inside a cloud, so as to enjoy solutions ondemand. Impair calculating identifies a brand new Internetbased that solutions to raise the particular use in addition to distribution model, typically concerning the World-wideweb to deliver energetic in addition to scalable and infrequently virtualized resources [2]. Fig. 1 indicates the particular construction associated with impair calculating. Impair will be the huge calculating system automatically split into a lot of scaled-down subroutines, in addition to then by means of multiple server techniques composing of a substantial lookup, computation in addition to evaluation after the outcomes back towards consumer. With this technology, the particular remote control supplier can certainly throughout a few seconds to achieve tens associated with thousands as well as handle huge amounts of us dollars associated with data for you to and the "super computer" the same highly effective effectiveness associated with system solutions [3]. It is going to likely employ a major impact on the particular large storage space later on. Nowadays, the phrase cloud computing may be a vital period on earth associated with IT. Figure1:Cloud Computing Deployment type along with solitude quantities, clouds can be grouped into the next several different types: Public Cloud: A new general public cloud can be a cloud that will it is commercial infrastructure is usually distributed simply by many mutually untrusted impair shoppers. Private Cloud: Should the commercial infrastructure of any impair is usually specialized in a certain corporation, we all talk about that will impair being a individual cloud. A personal cloud can be about or maybe away from premise. Community cloud: Community clouds are usually clouds that will their particular companies are usually available with a unique number of businesses which usually kind a residential district. Community clouds can many become about or maybe away from premises. Hybrid cloud: A new cloud that's a structure involving a couple of forms of clouds is called a mix of both cloud. 119

2 II. LITERATURE REVIEW Cloud computing is some sort of computing and that is highly scalable and use virtualized resources that will be shared because of the users. Cloud Computing currently is one of the new technological know-how trends will likely have a new significant have an effect on mass storage space[4][5]. Many in the previous work in the field of cloud computing are in the elements of new engineering, general explanation in the cloud technological know-how, differences involving similar engineering, security requirements as well as the future targets in these kind of emerging conditions. Different functions have planned distributed data Storage infrastructures, a number of built with grid infrastructures [6]. In [7]storage systems centered on reaching this specific theoretical limit by evening out costs involving peers and designing redundancy schemes capable to provide far better communication-storage tradeoffs. In [8] regarded node heterogeneities inside grid storage space systems. 2.1 A System to Aggregate Multiple Heterogeneous Cloud Services Storage: By Guilherme Sperb Machado et. al. [IEEE-2013] Platform-independent cloud Storage System for Multiple- Usage defines any novel storage overlay aggregating heterogeneous cloud storage services, supporting both generic along with data-specific storage program types. For data-specific cloud storage services deficiency of data validation is exploited to produce a generic storage devices service. Platform-independent Cloud Storage devices System for Multiple-Usage comes with a single interface to finish users enabling storage devices and data discussing. 2.2 Toward Privacy-Assured and Searchable Cloud Data Storage Services: By Ming Li,et. al. [IEEE-2013] In this article, we identify the situation and challenges connected with enabling privacy-assured searchable cloud data storage products and services. Recent research advances on this field are surveyed, which claim that achieving functionally abundant, usable, and efficient search on encrypted data can be done without sacrificing privacy guarantee an excessive amount. The steady evolution of this field should bring expertise from the cryptography, database, as well as information retrieval towns. 2.3 An Efficient Cloud Storage Model for Heterogeneous Cloud Infrastructures: By Dejun Wang [ELSEVIER-2011] Cloud storage system with traditional storage systems, has the following differences: 120 Very first, from the functional demands, cloud storage systems for many types of network online hard drive services, such as standard storage system is designed for high performance processing, transaction processing apps; Second, the demand from the performance point of view, you first need to consider cloud storage service is data security, reliability, efficiency and other indicators, and because large-scale users, services a wide range of complex network environment, etc., to achieve high-quality cloud storage services will face greater technical challenges; Third, from data management perspective, cloud storage system must not only provide the traditional POSIX-like file access, but also to support the massive data management, and support the provision of public services function to facilitate the background cloud data storage system maintenance. III. CLOUD STORAGE A lot of the cloud computing commercial infrastructure is transmitted via a reliable data services and build different levels on the server visualization technological innovation, consisting of. It could be any place to deliver network infrastructure to use these services[9]. "Cloud" usually offers the computing needs of all users a individual access point. Cloud storage technique architecture model contains four layers. (1) Storage space layer: Storage layer is the standard part of the actual cloud storage. FC storage devices can be Fiber Channel storage devices can be IP NAS and also storage devices, and so forth., can also be considered a SCSI or SAS storage devices including DAS. Cloud storage can be a huge number involving storage devices as well as the distribution of a variety of regions, each various other through wide location network, Internet or FC Fiber Funnel networks together. (2) Basic management: Cloud-based storage management may be the core part is stored inside cloud part of the most difficult to accomplish. Based management from the clusters, distributed report systems and grid computing technology, cloud storage among multiple storage devices to work together, so that several storage devices start to provide a similar service, and to deliver bigger and more powerful better data gain access to performance. (3) Application interface layer: Cloud storage application interface layer may be the most flexible portion. Different operating devices can cloud the particular storage type involving business; develop another application service interface offered by different applications.

3 (4) Access layer: Any authorized user by way of a standard application program to log open public cloud storage technique, enjoy cloud storage devices service. Different running units of foriegn storage, cloud storage to deliver access to various sorts and access strategies. Through the user access layer, any authorized user can at any place, using a networked airport terminal device, according for the standard application program to log open public cloud storage program, enjoy cloud storage devices service. We will develop our project with help of open stack cloud, first we will create account on open shift then create an application with the help of eclipse, jboss server, mysql.we create different type of cloud services like doc and audio for storage all the file one store in cloud server use will any different name to the different cloud services name as cloud services. IV. PROPOSED SYSTEM Proposed System consist following steps to aggregate cloud services storage and upload files: 1. Encryption 2. File Fragmentation, 3. Managing Index 4. Data uploading process 5. MD-5 6. Cloud services for data storage File Fragmentation: The key advantages of experiencing the fragmentation step are: (1) send out file parts to many CSs worldwide, being managed within an overlay; (2) 1 entity (CS) struggles to reconstruct the whole file info, enabling an increased degree involving privacy; and (3) an error correction program code (e. gary., Reed Solomon) could be applied intended for data redundancy. Lower than replacement running the particular encoding step is that data could be stored anywhere, even if CSs demand file type restrictions. It enables the particular aggregation involving CSs safe-keeping: all CSs keep data, in much the same, independently involving file type restrictions. Managing Index: The index information, which holds the metadata about files, e.g., in which Cloud Service the file was stored, how the data was encrypted, how the file was split into several small chunks, and how the data was encoded into other file types. Data Uploading Process: After manage index of file. Files are uploading on different cloud services like Google drive, Amazon, Drop Box [10] and sound cloud [11]. Cloud Services for data storage: Initial, user absolutely essential register CSs references for his personal make use of. Assuming in which Google Picasa, Sound Cloud, Drop box, and Facebook or myspace credentials [12] tend to be registered while using the Application; the fragmentation process has the capacity to calculate in to how many report parts your PDF X could be split good maximum upload size of every CS [13]. In this specific use case the assumption is that your PDF Times is split into report parts. Figure 2.Proposed System The Proposed System key consists out of information entity of the projected System file upload process result and contain all parameter necessary to find and rebuild a file within the Proposed System. Three independent top level entities in proposed index: the file, Credential and part information. Only with all three entities the Developing Application can be search all resultant file parts and can reconstruct into original file. Application associated with storage technology can considerably reduce the volume of cloud storage devices servers, thereby reducing method development prices, reduce the machine caused because of the server 1 point associated with failure as well as performance bottlenecks, lower data tranny link, to produce system effectiveness and proficiency, and ensure the system proficiency stable functioning. 121

4 V. IMPLEMENTATION Proposed System has been implemented with the help of public cloud (Red hat-open Shift).Following step we performed for create cloud: Create account on open shift Create an application using OpenShift Dashboard.application include o JBOSS application Server o MYSQL 5.5 Database Server o PHP my admin 4.0 Mapping this Application with Eclipse (Kepler) After Mapping we perform all the functionality of proposed system o Encryption o File Fragmentation, o Managing Index o Data uploading process o MD-5 o Cloud services for data storage VI. RESULT Results are measured and analyzed on above factors and compared with traditional and other available systems. Several tables and graphs are shown by which effective comparison can be made on different views which strongly confirms the applicability of suggested approach. Table 6.1: Active User Details on public cloud S. No UserID UserName 1 Sarang123 Sarang 2 mtech123 mtech123 Fig.4 Activate user on public cloud Figure: 3. Application Description on open shift cloud Figure 3 describe application details of cloud which is created by us. Reaming functionality perform using language JAVA/JSP/Servlet. We create heterogeneous following clouds services for data storage In Above figure 4 shown user can login through with id and password and if not registered user can registered before process the public cloud. Dashboard of activate user on cloud. Cloud user can upload the files, view uploaded files, check status of files. Uploading process is describe in figure 5 122

5 Table 6.3: MD5 value for each File Fragments S. No Generated Hash value File File File In table 6.3 describe about the Digest the file fragments using the algorithm MD5.each file fragments contain different type of hash value. Fig.5. Uploading process of file in to cloud Table 6.2 show how much time needed for uploading different-different file size on cloud. File Name Table 6.2: Files and their Encryption time File Size (in KB) Encryption Time (in millisecond) (RSA) Test1.txt Test2.txt Test3.txt Fig.6. File details with their status VII. CONCLUSION Cloud computing for exciting development can be a significant alternate today s educative perspective. Cloud storage is not only just storage, far more applications. Applications stored inside the storage product is a built-in application software package functions associated with storage, which besides has information storage capabilities, also has the application software package functions, can be seen as an accumulation servers as well as storage products. REFERENCES [1] Guilherme Sperb Machado, Thomas Bocek, Michael Ammann, Burkhard Stiller A Cloud Storage Overlay to Aggregate Heterogeneous Cloud Services 38 Annual IEEE conference on local computer network 2013 [2] Ming Li, Utah State University Shucheng Yu, University of Arkansas at Little Rock Kui Ren, University at Buffalo Toward Privacy-Assured and Searchable Cloud Data Storage Services 2013 IEEE IEEE Network July/August 2013 [3] Dejun Wang An Efficient Cloud Storage Model for Heterogeneous Cloud Infrastructures 2011 Published by Elsevier Ltd. [4] Guilherme Sperb Machado, Thomas Bocek, Michael Ammann, Burkhard Stiller PiCsMu: A System to Aggregate MultipleHeterogeneous Cloud Services Storage 38 Annual IEEE conference on local computer network 2013 [5] Amazon.com Web Services: Products and Services. Available at: Last visited on: March [6] Dropbox: Dropbox Service. Available at: dropbox.com. March [7] Google Corporate: Google Products and Solutions. Available at: Last visited at: March [8] ID3 Website: ID3 Version 2 Standard. Available at: id3.org. May [9] JSON-RPC Website Specification: A Light Weight Remote Procedure Call Protocol, Specification 2.0. Available at: jsonrpc.org. April

6 [10] V. I. Levenshtein: Binary Codes Capable Of Correcting Deletions,Insertions And Reversals. Soviet Physics Doklady, Vol. 10, No. 8,February 1966, pp [11] Microsoft: SkyDrive, Files Anywhere. March [12] OAuth Specification: OAuth 2.0 Specification. Available at: Last visited on: March [13] Otixo: All Your Cloud Files from a Single Login. Available at: Last visited on: March [14] PiCsMu Website: Platform-independent Cloud Storage System formultiple Usage. Available at: May [15] SalesForce.com: The Leader of Customer Relationship Management(CRM) and Cloud Computing. Available at: visited on February [16] Broberg J, Venugopal S, Buyya R. Market-oriented grids and utility computing: the state-of-the-art and future directions.journal of Grid Computing 2008, 6(3): [17] Open Grid Forum. Cloud Storage for CCSN. For Cloud Computing.pdf [18] Erickson, J. S., Spence, S., Rhodes, M., Banks, D., Rutherford, J., Simpson, E., et al. Content-Centered Collaboration Spacesin the Cloud. IEEE Internet Computing, 2009, 13(5), [19] Grossman, R. L., Gu, Y. H., Sabala, M., & Zhang, Theory Methods and Applications, 2009, 25(2), [20] Y. Deng, F. Wang, A heterogeneous storage grid enabled by grid service, SIGOPS Oper. Syst. Rev. 2007, 41 (1):