UCD IT Services. Data Storage in the UCD Cloud

Transcription

1 UCD IT Services Data Storage in the UCD Cloud Customer Policy, Procedures & Information Project: Description: Data Storage in the UCD Cloud Customer Policy, Procedure & Information Document Version: 10 Last Modified: By Ruth Lynch on 4 October 2010 Budget Code: Abstract N/A This document covers briefly the policies and procedures to be followed for Data Storage customers. Ruth Lynch Page 1 of 7 Version 10

2 Table of Contents Introduction...3 Pre-application Considerations...3 Backups...3 Technical Considerations...3 Client / Initiator Hardware Options...3 Client / Initiator Operating Systems Options...3 Configuration...4 Client / Initiator Configuration Options...4 CHAP...4 LUN Details...4 Getting Storage...5 The Process...5 Charges...5 Application Steps...5 Next Steps...6 Accessing the Storage...6 Further Information...7 Ruth Lynch Page 2 of 7 Version 10

3 Introduction UCD IT Services have traditionally provided high available storage to all users. Now, given the large volumes of data created by the research community, researchers can purchase data storage space on reliable highly available mirrored storage, hosted, and administered by UCD IT Services. The storage system is collocated in the Research IT Data Centre and the UCD Computer Centre, which allows for disaster recovery. It can be accessed easily and quickly via the existing network using iscsi; allowing researchers to locate their servers either within the Research IT Data Centre or anywhere on the UCD network. Pre-application Considerations By its nature iscsi connectivity can be delivered to anywhere on the UCD Network and as such this gives customers flexibility in connecting to the storage. However, customers should be aware that the location of the iscsi Client, its hardware configuration and network connectivity all contribute to the delivered performance of the iscsi storage. Backups Customers should be aware that the UCD IT Services Storage Solution is not backed-up to tape by default. However, there is a Backup Service detailed in the UCD IT Services information document, Backups as a Service. This is an additional service and such has additional costs associated with it. Technical Considerations Client / Initiator Hardware Options Once a customer has decided to use the UCD IT Services SAN, the following options are available to the customer: Client Location: Local Building / Data Centre Hardware: Shared NIC / Dedicated NIC NIC Type: NIC / TOE NIC / iscsi HBA UCD IT Services recommend that each client have a dedicated NIC attached to the iscsi VLAN local to the client. Ideally this should be an iscsi HBA or TOE NIC to get the best performance. Client / Initiator Operating Systems Options Due to the large variety of operating systems on the UCD network, UCD IT Services are unable to guarantee support for iscsi on every OS. However, the Research IT Services Team will assist all customers, under a best efforts understanding and regardless of OS, to connect successfully to the UCD IT Services SAN via iscsi. UCD IT Services can provide support, and documentation, under the following operating systems: Red Hat Linux (RHEL 4 & 5) Microsoft Windows Server 2003 Ruth Lynch Page 3 of 7 Version 10

4 Note: Fedora Core 8 Intending users of the UCD iscsi storage solution should be aware that the iscsi client / initiator that they intend on using is required to support target redirection as this is a core component of the service. Configuration Client / Initiator Configuration Options The client / initiator software installed and used is dependent on the Client Operating System. Whilst many operating systems are now supplied with iscsi software built in, these may not always work successfully. For example UCD IT Services recommend that you use the Cisco iscsi Initiator for connecting Microsoft Windows servers to the iscsi storage. This is available for download at The iscsi connectivity in UCD is provided using Cisco technology and Cisco iscsi software is also available at the above URL for a variety of operating systems. A benefit from the manner in which iscsi services are configured in UCD, there is one single target IP Address to which users need to connect. This solution means that operating systems unable to support iscsi multi-path fail-over can benefit from path fail-over through the UCD solution. As a result customers need not configure multi path iscsi thus simplifying connection. CHAP CHAP is an authentication scheme used by Point to Point Protocol (PPP) servers to validate the identity of remote clients. CHAP periodically verifies the identity of the client by using a three-way handshake. This happens at the time of establishing the initial link, and may happen again at any time afterwards. The verification is based on a shared secret (such as the client user's password). [RFC 1994] UCD IT Services intend to implement CHAP authenticated iscsi when possible. LUN Details UCD IT Services allocate a LUN, or a number of LUNs, for a customer to access allocated storage. The maximum amount of storage that can be allocated per LUN is currently 2TB. Customers requiring more than 2TB of mirrored storage will be allocated one LUN for each 2TB, or part of, requested. For example if a customer requests 5TB of storage then 2 x 2TB LUN and 1 x 1TB LUN allocations will be made. Ruth Lynch Page 4 of 7 Version 10

5 Getting Storage The Process The process involved in availing of the opportunity to participate in the UCD IT Services storage solution is very much discussion based. In order to ensure that this discussion is based on the customer requirements from the outset, customers are encourage to first complete the web form available on Research IT Services Storage Enquiry Form available on Once this has been received customers will be contacted by the Research IT Services Team to discuss storage requirements, storage access requirements and costs. This process allows customers the opportunity to assess their storage needs from both an immediate and future perspective. Charges Storage is now charged on an annual basis to the owner of the iscsi Storage. This means that should you own and administer a server to which other users have connected iscsi LUNs and are not the owner of these LUNs you will not be charged. UCD IT Services charging policy is based on the cost incurred in providing a service, in this case iscsi Data Storage, to that customer, not on a cost recovery basis for the overall service. UCD IT Services provide all of the infrastructure including the fibre backbone, hardware and software backend and related licensing. Storage is charged for on the basis that each 1TB of storage is mirrored across sites. Details of all charges associated with services in the UCD Cloud are detailed in the UCD IT Services information document UCD IT Services - Payments for UCD Cloud Services. Charges are applied annually in advance and are subject to review 1 Application Steps As already mentioned, the application procedure is a discussion-based process. However, in order that this process itself is transparent to the customer, each logical step in that process is outlined below. 1. Customer assesses their data storage needs and completes the Storage Enquiry Form on 2. Research IT Services contacts the customer within three working days to discuss the customer storage needs and associated costs. This discussion will gather and agree the following: Duration for which iscsi Storage is required Amount of storage required immediately along with customer forecast increase / decrease in needs. 1 Whilst charges are subject to review it is not UCD IT Services intention that this would be in an upward direction. However, it should be noted that where maintenance or supplies such as tapes increase dramatically in price that UCD IT Services would not be in a position to absorb the full cost. Ruth Lynch Page 5 of 7 Version 10

6 Client Operating System(s) and initiator software identified. Client network location Hardware requirements & Configuration options Cost of the storage to the customer 3. Research IT Services will with the UCD IT Services Operations Team establish the ability of UCD IT Services to fully satisfy the customer requirements. 4. When the customer is satisfied that they wish to proceed with obtaining storage from UCD IT Services, a funds transfer of the total cost agreed should be made to UCD IT Services. This will be arranged with the UCD IT Services Finance Officer. 5. Research IT Services will complete the request process within UCD IT Services. Next Steps Accessing the Storage Setting Up iscsi Once the appropriate iscsi software has been installed on the server then the customer should 1. The customer must ensure that the agreed hardware configuration for iscsi connection has been met. In the case where a test LUN is being provided to the customer there is no requirement for the customer to provide a dedicated NIC for iscsi connection. These are short term connections. In the case where the LUN is being allocated on a more permanent basis, customers are required to provide a dedicated NIC to handle iscsi traffic. This configuration provides for separation of iscsi traffic from other general network traffic, improving performance and security. UCD IT Services recommend that customers configure two dedicated iscsi NICs for redundancy within the server. 2. Customers are required to register dedicated iscsi NICs for IP Address allocation. 3. The customer is responsible for configuring their own equipment to access the iscsi storage, however the Research IT Services Team are available to assist and advise where possible. Amongst the configuration settings for which the customer is responsible are the following: Initiator name should be set to reflect the host name of the client. For example if the default initiator name is set to: InitiatorName=iqn com.redhat:researchit-gx520.ucd.ie and the host name of the client is Ruth Lynch Page 6 of 7 Version 10

7 customer-server.ucd.ie then the customer should reconfigure the initiator name to: InitiatorName=iqn com.redhat:customer-server.ucd.ie 4. CHAP authentication settings on the initiator (when available through the UCD IT Services storage solution) Connect to the Storage 1. Once iscsi is configured on the client the customer should perform a Target Discovery to the IP Address And inform the Research IT Services team that this has been done. 2. The UCD IT Services Operations Team will then allocate a WWN to which the requested LUN(s) will then be presented. 3. The Research IT Services Team will contact the customer to ensure that they can mount the storage. 4. The customer will then format the storage for use as required. Further Information Further information, and regular updates on the iscsi Storage Services is available on the Research IT Services web page at links to a variety of drivers and other storage related information will also be available from this site. Support Support for iscsi storage is available to customers through the UCD IT Services Helpdesk at helpdesk@ucd.ie or by telephone at extension All queries relating to the information contained within this document should be directed to ResearchIT@ucd.ie Ruth Lynch Page 7 of 7 Version 10