How To Build A Multi-Site Data Center

Transcription

1 جامعة العلوم والتكنولوجيا الا ردنية داي رة العطاءات المرآزية عطاء رقم ) 2010/72 ( Data Center State Of The Art Storage & Backup Consolidation With Disaster Recovery الجيل الجديد من مراآز البيانات والمعلومات

2 1) Overview Jordan University of Science and Technology (JUST) is always working to enhance its infrastructure to be standardized and to get the best possible performance and security level, JUST mission is to work strenuously to adopt the technological and scientific advancements and enhance the role of scientific research and development to achieve sustained national comprehensive progress. 2) Tender objectives JUST is in the phase of transforming its IT Data Center to the state of the art Data Center by implementing multi technologies on multi PARTS, starting with storage infrastructure consolidation to serve virtual and physical server farms, Backup and Disaster Recovery. Having this, JUST will be able to fulfill the following objectives: Streamline growth, simplify data sharing, and reduce management tasks and costs by consolidating the storage infrastructure. A better responsiveness and greater productivity by acquiring the state of the art storage system by deploying a fast and dependable storage solution. A complete data protection, reduced downtime, and improved application Performance, to meet service level and compliance requirements utilizing backup solutions Reduce backups by eliminating duplicate, expired, and inactive data utilizing deduplication for the virtual tape library. Building and infrastructure that can scale and support future disaster recovery plan. Building an infrastructure that supports a future Continuous Data Protection in the storage subsystem. This document is an invitation for qualified bidders to offer their solutions in Three parts to deliver, install, and accommodate all the requirements as described in this document. All Technical details are mentioned in specification section.

3 2) General Terms and Conditions 2.1. It will be the bidder s sole responsibility and on his own expenses to understand the site nature and environment and all requirement that are related to the tender or that may influence it's pricing The bidder will be fully responsible for verifying any information that may be made available to him. Under no circumstances will JUST be deemed responsible for the consequences of any such offered information Bidders requiring further information or clarifications may notify JUST in writing at Central Tendering Department, JUST will respond in writing to any request for information or clarification of the bed To assist in the examination, evaluation and comparison of bids, JUST may at his discretion ask the bidder for a clarification of his bid. Such clarification shall be in writing and no change in the price or substance of the bid shall be sought offered or permitted JUST will determine to its satisfaction whether the bidder selected as having submitted the lowest-evaluated responsive bid is qualified to satisfactorily perform the project The determination will take into account the bidder s financial technical and production capabilities. It will be based upon an examination of the documentary evidence of the bidder s qualifications submitted by the bidder as well as such other information that JUST deems necessary and appropriate An affirmative determination will be a prerequisite for award of the tender to the bidder. A negative determination will result in rejection of the bidder s bid JUST will award the tender to the successful bidder whose bid has been determined to be the most proper responsive bid, provided further that the bidders is determined to be qualified to satisfactorily perform the Contract The Tender will be awarded as separate lots, so each part of the tender will be considered as a separate lot The bidders may consider the specifications in the technical specifications sections item 9 as guidelines for building the solution that achieve the goal. Bidders can offer products that can achieve the goal with modified specifications and JUST has the right to consider whatever it deems appropriate.

4 2.11. If any Item needed during the installation and was not stated in the offer; then it is the bidder s responsibility to provide it at no cost The bidder should provide list of references for similar solution JUST will have the right to choose one of these references for a site visit a long with the bidder, bidder s should provide that with no additional charges or cost. 3) Format of the Proposals The proposals have to be developed based on PMI standards and shall include the following sections: Overview. Detailed hardware and software description. Prices: All prices should be in JD, clear, itemized and include all taxes. If an item is not priced then the offer will be considered not satisfactory. Bidder qualifications: as requested later in this document. Training: as requested later in this document. Installation and testing plan: as requested later in this document. Warrantee, maintenance and technical support. 4) Evaluation Criteria Evaluation Step 1: Compliance with specs. Must provide a compliance sheet in the offer. Must pass this step to move to the next evaluation step (step 2). Evaluation Step 2: If the offer passed this step by getting a score more than 70%, then move to the third step of evaluation (step 3): Quality of proposed products. 10% Bidder Qualification. 25% Warrantee, maintenance and technical support. 20% Training. 10% Installation and testing plans. 35% Evaluation Step 3: Price.

5 5) Bidders Qualifications Bidder should have enough experience and certified technical staff to do the installation and support. Name, experience, certificates and CVs of the staff who will do the installation and support should be included. The bidder must nominate in his offer a certified project manager who will lead the company project team during the implementation of the project according to PMI standard. The bidder must nominate in his offer a direct vendor certified engineer who will be the technical team leader of the company project team. References for similar project should also be included. 6) Training a. Site Training: The offer should include site training for the technical staff of the CIC. Training must focus on the following: o Operation. o Problems and fault analysis. o Software installation and administration for the associated solution. o Configuration. o Management. b. Certified Training: Offer must include a direct vendor certified training which should be held at a vendor owned facilities. Pricing of this training must be per trainee. The training has to meet the following requirements: 1. including original training kit and material 2. Offered by a vendor certified instructor. 3. the offered training must cover all expenses of the travelling costs including and not limited to travel tickets, accommodation, transportation and living costs. 4. Training dates must be listed in the offer. 5. Training must be completed before the final acceptance of the project.

6 7) Implementation, Installation and Testing Plan The bidders must provide an implementation/installation plan developed according to PMI standard for project management. It must have milestones clear timetable. Project schedule must take into consideration the work environment of JUST including the periods during which network and service interruption is not possible. These periods include but not limited to: students registration period, online exams period, and ordinary working hours. All hardware and software components must be individually tested as well as the whole solution must be tested entirely. The successful bidder must develop reports for all serial numbers of all awarded and delivered devices and to document devices configuration. These reports must be submitted before the final acceptance of the project. 8) Warrantee and maintenance All devices, hardware and software components should be warranted for three years starting from the date of acceptance. Maintenance offer should include a maintenance contract with detailed terms for technical support, response time and spare parts needed. Direct support with the vendor is required as part of this solution. Offer must include a clear way and contacts information that JUST technical team can use in case of problems. Offer of warrantee service must be clear and bidder must show his commitment for doing the following: o Response time for problem call. o Response time for problem solving. o Response time for software/configuration support call. o Response time for solving software/configuration support call. o Response time for (hardware/software) failure. o Actions that will be taken during (hardware / software) failure. o Response time for failed hardware replacements.

7 9) Technical Specifications The following specs are the minimum requirements, bidders who offer enhanced specs with competitive prices will have advantage. Very Important The following mentioned Items & Quantities are JUST expectation of basic needs to run the setup o If other items (Software/Hardware) are needed to make the setup functional bidders must quote for them in their offers. If any Item needed during the installation and was not stated in the offer; then it is the bidder s responsibility to provide it at no cost. o It is the bidder responsibility to make sure that the requested solution are compatible with each other and compatible with the existing infrastructure; if the bidder found anything wrong he has to highlight that in his offer and he has to offer correct and better alternatives than what are required by this RFP. o Bidders are urged to quote for all options and; although they may not be purchased at this phase it will give clear vision of future expansions. o The Tender will be awarded as separate lots, so each part of the tender will be considered as a separate lot. o JUST has the right of excluding items or any parts when awarding this tender, in order not to exceed the available budget.

8 PART I This part consists of three major items Item 1: Storage Area Network - SAN Storage The offered SAN Storage must have at least the following features and specifications while assuring the following points: Performance Latest Technology Management Security Capacity Scalability Ease of Use High Availability Interoperability with existing setup 1.2. Standard High Availability Features: - Must be the latest model/generation and not end of technology or end of life. - High Availability features: o 100% fully redundant hot swap components with No Single Point of Failure o Five 9 s availability (provide report) o Storage with 64-bit OS. o Redundant Hot swap Controllers. o Redundant Hot swap Power supplies and cooling fans. o Redundant Hot Swap Hard Disk Drives o Online (Non-disruptive) Software upgrade. o Online (Non-disruptive) Hardware Changes. o Mirrored Cache o Redundant Data Paths. o Storage system shall Support call home service functionality as well as remote diagnostic capability o Inbox upgrade to higher models within the family with data in place.(zero Data Loss).

9 1.3. Capacity & drive technology: Bidders must quote for all options (1,2&3) and; although they may not be purchased at this phase it will give clear vision of future expansions Option 1: - 20TB total of usable capacity distributed as follows: o 15.5 TB usable capacity using 75 x 300GB 15K RPM FC HDD with RAID5 (4+1) o 1 TB usable capacity using Flash Drives/SDD/EFD, 5 x 200GB RAID 0 o 3.5 TB usable capacity using, 5 x 1TB 7200 RPM SATA HDD with RAID5 (4+1) - Hot Spare Drives as follows: o 3 x 300GB 15K RPM FC HDD o 1 x 1TBGB 7200 RPM SATA HDD o 1 x 200GB Flash Drive/SDD/EFD Option 2: - 30TB total of usable capacity distributed as follows: o 25.5 TB usable capacity using 80 x 450GB 15K RPM FC HDD with RAID5 (4+1) o 1 TB usable capacity using Flash Drives/SDD/EFD, 5 x 200GB RAID 0 o 3.5 TB usable capacity using, 5 x 1TB 7200 RPM SATA HDD with RAID5 (4+1) - Hot Spare Drives as follows: o 3 x 450GB 15K RPM FC HDD o 1 x 1TBGB 7200 RPM SATA HDD o 1 x 200GB Flash Drive/SDD/EFD Option 3: - 50TB total of usable capacity distributed as follows: o 38.5 TB usable capacity using 85 x 600GB 15K RPM FC HDD with RAID5 (4+1) o 1 TB usable capacity using Flash Drives/SDD/EFD, 5 x 200GB RAID 0 o 11 TB usable capacity using, 15 x 1TB 7200 RPM SATA HDD with RAID5 (4+1) - Hot Spare Drives as follows: o 4 x 600GB 15K RPM FC HDD o 1 x 1TBGB 7200 RPM SATA HDD o 1 x 200GB Flash Drive/SDD/EFD

10 - The ability to mix different drive technologies (SATA, FC & Flash Drives) - Supports the following HDD: o FC Drives: 146GB 15K, 300GB 15K, 450GB 10K & 15K, 600GB 10K & 15K. o Flash Drives: 73GB, 200GB & 400GB. o SATA Drives: 1TB 5.4K & 7.2K, 2TB 5.4K & 7.2K. - Must support the following RAID levels: RAID (0, 1, 1+0, 3, 5, and 6) with the ability of mixing RAID levels. - Storage shall be able to migrate data from one RAID type or set of drives to another without impacting applications within the same system.. Vendor shall include any software needed to achieve this functionality. - Expandable to at least 120TB 1.4. Drive Enclosure: - Drive Enclosures: must accommodate min 14 disk drives per enclosure, offered configuration with min 5 enclosures, upgradable to min 8 enclosures Connectivity: - Modular and flexible connectivity design, ready with built in : o 4 x 8Gb FC Ports. o 4 x 1Gb iscsi Ports - Support the following in box online port expansion: o Up to 4 x 10Gb iscsi o Up to 12 x 8Gb FC - The ability to mix 8Gb FC, 4Gb FC, 1Gb iscsi and 10Gb iscsi in the same time. - Online ports expansion, and the ability to integrate future technologies when released Controllers & Cache: - Redundant Controllers with 6GB mirrored cache per controller pair. - Cache de-staging to disk with no time limit for restoration.

11 1.7. Management & security: - Storage system shall have Virtualization aware Storage-based Management software with unlimited capacity, accessible via web-browser. Administrator can create host-toarray Communication Bridge and script/automate common storage management tasks. - Storage system management shall have Software Security via SSL, user identification and Access Control. - Storage shall support over provisioning applications in order to reduce physical storage capacity requirements. Vendor should include all software and licenses to support it. - Intelligent high performance multi path management and utilization software supporting Hosts connected to SAN (to be offered) - Storage system shall support both Pointer-Based Snapshot and Full-Volumes copies (clones). (Please specify the number of snapshots and clones that can be taken for a single LUN). - Snaps & Clones with the ability of integrating this feature with Virtual provisioning (to be offered) - Fully automated in-box LUN movement between storage tiers. (Optional). - Storage system shall have the ability to expand an existing LUN online through striping or concatenation, this shall increase performance capabilities by allowing volume to span a large number of drives and enable better capacity utilization by non-disruptively expanding capacity anywhere in the array. Vendor shall include any software needed to achieve this functionality - Storage system shall support optimize performance based on policy management: o Set performance goals for critical applications. o Set limits on lower priority applications. o Schedule policies to run at different intervals. - Storage system Shall have Heterogeneous host support and array based LUN masking including ESX, W2K, Win2003,Win2008, HP UX, Sun Solaris, IBM AIX, and Linux (Vendor shall provide guaranteed interoperability support matrix).

12 Item 2: Storage Area Network Switches - SAN Switches. Two SAN Switches with the following specifications and features: - 32 x 8Gbps per switch, fully populated Ports with OM3 LC/LC 10m cables. - Supports up to 40 ports per switch. - Support 1, 2 4 and 8Gb/s FC speed - Capability of frame based trunking across ISL for optimal performance - Capability to support QoS to prioritize traffic on ISL - Full fabric architecture with 239 switches maximum - Capability to report most important traffic flows in the fabric (Top Talkers feature) - Compatibility with 1Gbps and 2Gbps products - No oversubscription at 8Gbps speed - Aggregate bandwidth: 320 Gbps - Power consumption is below 0.5 watt per Gb/s of data rate. - Support of DHCP for IP address management allocation - Availability of a USB port for maintenance operations - Support of long distance ISL over more than 500 Km - Port on demand upgrade capability starting from 8 ports to 24 ports - Dual, hot-swappable redundant power supplies with integrated system cooling fans Item 3: Rack Cabinet. - Min 40U size, same brand rack cabinet with all needed PDUs and accessories.

13 PART 2 Backup solution Fast Inline Deduplication the most efficient and economic method of deduplication, it significantly reduces the raw disk capacity needed in the system since only deduplicated data Is written to disk x average data reduction Fast Time to Disaster Recovery Readiness as part of the inline deduplication process, the system does not need to wait to absorb the entire data set before it can begin replicating to the remote site. Data is available for recovery at a DR site faster than with other deduplication products or by physically transporting tapes on trucks. Should Support leading backup and archive applications from EMC, HP, Symantec, IBM, Microsoft, CommVault, BakBone, CA, Atempo and others. Should Support leading enterprise applications including Oracle, SAP, DB2, SQL, Exchange, VMware, and SharePoint Simultaneous use of VTL, NAS and Symantec OpenStorage Multi-site, Cost-Efficient Disaster Recovery delivers up to 99% bandwidth reduction, provides flexible replication topologies, multi-site tape consolidation and replication from up to180 remote sites (2,880 for DDX). Ultra-safe Storage for Reliable Recovery Should have a Data Invulnerability Architecture which provides continuous recovery verification, fault detection and healing plus dual-disk parity RAID-6. Operational Simplicity Should lower administrative costs, provide power, cooling and space efficiencies for environmentally friendly operations, reduces hardware footprints and supports any combination of backup and archive applications in a single system.

14 PART 3 Remote replication. Replication will be IP based through the available link between main site in JUST university and its DR site in Irbid, the link is routed through Amman. The offered solution should be: 3.1 An enterprise-class remote replication solution that delivers any-point-in-time recovery with complete protection from site disasters. 3.2 Dynamically switches between synchronous and asynchronous replication based on policy for performance and latency. 3.3 Enterprise performance, scalability, and granular recovery combine to guarantee data consistency with recovery that takes seconds or minutes instead of hours or days. 3.4 Transmits only changed blocks across the WAN 3.5 Supports target site processing for DR testing 3.6 Native supports of replication for consistency groups 3.7 Support integration with VMWare SRM 3.8 Supports integration with Microsoft VSS and VDI APIs for application quiescence

15 Compliance Sheets The bidder must fill the following compliance sheets Sheet No.1 SAN Storage Features Compliance Sheet: Compliance (Yes/No) Requirements Technology Must be able to support Flash Drives to maximize the performance by expanding available storage tiers within the box and reduce power consumption Must be able to over-provision applications in order to reduce physical storage capacity requirements therefore reduce cost while improving manageability Environmental Must be able to support low-power or green high-capacity disk Must have ability to power disk drives down when not in use to minimize power consumption for long term data retention needs such as backup, archiving and large data set analysis Must provide compliance with standards for harsh environments and environmental safety, the system must be certified to NEBS Level 3 and ETSI for demanding environments. Qualifications include: Extreme high and low temperatures Operation in humid and damp environments Functionality at a very high or low altitudes Ability to withstand high forces of shock and vibration Additional qualifications address environmental safety: Reduced risk of fire hazard Electromagnetic compatibility Minimize radiated emissions and impact to adjacent environment, resistance to lightning and power faults, and minimal acoustic noise

16 Management Must be able to migrate data from one RAID type or set of drives to another without impacting applications within the same system. Virtual LUN and Virtual Provisioning technologies to provide Transparent In-Box Data Mobility Must provide automated analysis of data activity as well as automated migration of data between storage tiers to achieve improved performance and TCO Must provide active system management and user-directed control of system resources Must provide automatic monitoring of disk drive health and initiate a proactive background drive rebuild on failing drives Must have built-in support for Concurrent Local and Remote Replication Security Must provide multiple levels of access control including role-based security and auditing capability Capacity Must be able to scale well over 1 Petabyte to meet archiving and B2D requirements in a single system Scalability High Availability Investment Protection Must be able to support all on-line data storage tiers in order to maximize both system performance and capacity scalability Must be able to provide additional connectivity to meet existing or future needs for front end port counts and future technologies Must provide five 9s availability (99.999%) (Report to be provided) Must keep write caches persistent during fault conditions to prevent data loss Must provide upgrade path to larger or future array controller and software technology while maintaining our existing investment

17 Sheet No.2 Backup Software Features Compliance Sheet: Compliance (Yes/No) Requirements Must enable client-side (source-based) deduplication for file systems and applications. Must provide efficient de-duplication ratios beyond single instance storage. Must enable deduplication and traditional backup from a single software agent and/or module footprint. Must enable day-to-day control, scheduling and management of all backup operations including dedupe and non-dedupe via a single user interface. Must enable scalability through the addition of secondary media servers / nodes under control of a central backup server. Tapes must be self-describing to ensure data can be recovered even in the case of loss of central indexes. Must support the ability to multiplex data to tape to ensure tape drives are used to maximum efficiency. Must support usage of tape drives and mixing of data from both NDMP and non-ndmp data. Must support and integrate with the Disk Library. Must enable support for snapshot management with coordinated application protection on storage platforms Must enable support for snapshot management with coordinated application protection on storage platforms Must support backup and recovery coordination with future Continuous Data Protection and Continuous Remote Replication Must support for off-host proxy-based backup including network and LAN-free with block-level backup and restore of unlike operating systems. Must support backup / recovery of raw SCSI volumes on Symmetrix. Must support backup / recovery with cloud based storage as a service for easy offsite data protection. Must provide centralized, web-based administration with a single view of all backup servers within the enterprise. Must provide built-in reporting. Must support wizard-driven configuration and modifications for backups

18 Must enable 256-bit AES encryption on the backup client. Must provide broad support for hot application backups Must provide coordinated Disaster Recovery with the SharePoint Volume Shadow Copy Service (VSS) Writer Must provide selective granular backup and recovery for SharePoint Must provide source-based deduplication for all major business applications Must feature broad operating system support for backup server, media server and client. Must deliver efficient, profile-based bare metal server recovery without addition of a separate client installation. Must support dissimilar system hardware restore on multiple platforms Must support backup / recovery for VMware in the Guest, at the Console level and with VMware Consolidated Backup with both traditional and source deduplication backup from the same solution. Must support VCB-based off-host backup for VMware without the need for scripting. Must support backup and recovery for Microsoft Hyper- V using VSS at the Parent Partition to protect both the Parent and Child. Must support backup and recovery with VSS for applications running within a Microsoft Hyper-V Child Partition. Must support proxy-based off-host backup workflows including LAN-free for virtual servers.

19 Sheet No.3 Backup VTL Features Compliance Sheet: Compliance (Yes/No) Requirements System must be capable of ingesting, deduplicating and compressing data before it is written to disk. This requirement is in place to ensure deduplication of data occurs in-line at the point of data ingest, and not in a post processing manner (where data is first written to disk, then deduplicated). This process must also take place on the disk backup target, and not on the client being backed up. This capability is required to ensure efficient use of usable disk space, minimize compute components associated with the solution, maintain solution simplicity and have architecture in place for WAN based DR with minimal data movement latency. The inline deduplication should be based on CPU and not on the disk capacity at all. All the processing should be done by the CPU System must use variable length segments for deduplication How long will it take from initiation of backup of a 5000GB database through storage, dedupe, and replication over T3? System should offer RAID-6 for double-disk failure protection? The system should be capable of delivering OST capability. Deliver an installation checklist. Can you have backups started within the 2 nd hour of implementation? Can you do NFS, CIFS, NDMP, and VTL, and NAS archive storage at the same time in the same box? Can you be an NDMP initiator and target for NAS filers? What is your NFS average throughput performance? What backup vendors and releases are supported and tested? Deliver your support matrix document. When does replication start? Does it start within the first few minutes of the backup job? Explain? Is the system customer installable?

20 How many disks or racks will it take for our data set with 3 month retention? (future growth considerations) Capability to present as an NFS/CIFS network share. System must also have the capability to present multiple VTL s on a single FC port.. Capability of presenting all physical disk as one partition and one resulting mount point for backup data. Algorithms used in deduplication process must have coupling and resulting access to RAID6 parity to ensure data presented to the system is preserved/protected when written to disk. System must have RAID6 (with at least 1 hot spare per shelf of disk drives) and N+1 Power Supplies and Fans. All of these components must be hot-swappable and not require downtime if service on one of them is required. The system must also have battery backed-up NVRAM. When a second system is deployed and available over IP connectivity, the systems must be capable of communicating and transferring only the deduplicated, unique bits. This replication between systems must be uni- or bi-directional, and there must be the capability to designate which data is/isn't replicated. The capability to throttle bandwidth between the two systems must also be available. The systems must be capable of initiating data replication while the data backup process is running (not after the backup process has been completed). Assuming no network limitations and available system resources, replication of data should complete within 30 minutes of the data backup procedure. Can the system be used as a destination for archive storage?

21 . Appendixes JUST current datacenter (shown below) consist of three major islands of Application/Database, each of which has its own physical recourses such as servers, switches, storage and backup HW/SW, as follows: 1- Oracle RAC: 2 x SUN sunfire V x SAN Switches + SUN StorageTek SUN V240 backup server & SUN StorEdge C4 LTO3 library with Veritas NetBackup. 2- MySQL: 2 x SUN sunfire V x SAN Switches + SUN StorEdge T3 + SUN V440 backup server & SUN StorEdge L25 library with Veritas NetBackup 3- Microsoft Infrastructure (elearning, SharePoint, Exchange, SQL & System Center: 14 x IBM BladeCenter H Solution + SAN Switches + IBM DS IBM Library with Backup Exec.

22 Existing Datacenter Design

23 New Datacenter Part I (Storage Consolidation) In this part (Part I), SAN Storage and SAN Infrastructure to be consolidated while centralizing the backup by using one of the existing solution. Having the site ready for Part 2.

24 Part 2 will take JUST DC to a next generation from RPO & RTO perspective. Enhancing the backup and restore technique by implementing the deduplicate technology, and implementing remote replication to a DR site. Backup Diagram (Backup & Recovery)

25 Final Diagram of Remote Replication