1 Dmitry Basistiy, independent consultant, member of the Board, Association of data-centers of Russia DCExpedition Scandinavia Tour 2014: travel notes of a wandering technocrat DCExpedition Scandinavia Tour project, held in November 2014, aimed at familiarizing participants with the best samples of DC construction of two countries: Sweden and Finland. There were 48 participants in the expedition - representatives of the dc owners and operators, engineering companies and some independent experts and consultants. A route and program of the tour were extremely intense: arriving in Stockholm Swedish program departure to Turku by ferry, early arrival in Turku - setting off to Helsinki by bus visiting DC Finland and Eaton factory going to Kajaani by plane followed by an evening event in the Finnish style; visiting Renforsin Ranta business park and acquaintance with two data centers there departure to Helsinki and back to Moscow. The whole route took less than four days. Helsinki, Finland DATACENTER FINLAND. It is a private datacenter located in Helsinki s suburb on the second level of the building s basement which used to be the premises of a telecommunication company. Designed and built by Coromatic. Datacenter is connected to external electrical grid via 2 lines, power system based on 3 UPSs with reservation N+1. Total capacity 1,8 MW The air cooling system in the server halls is based on Carrier s solutions N+1 with cold feed from under the raised floor. Datacenter is designed by the class of fire safety F120. Fire extinguishing system is centralized, built on a solution using argon as an extinguishing agent, which is placed in the pressure cylinders 300 atmospheres! (It should be specially noted that in the Russian practice the use of cylinders with these characteristics is an extremely rare phenomenon. In addition, all cylinders are placed in the same room with the UPS equipment and are not anyhow isolated.) Datacenter power usage efficiency coefficient (PUE) is estimated at 1,3-1,5. DC does not have any official certification, but the operator assigns it to a class Tier 3 classification TIA-942. Bold and unusual solutions for Russian eye: Datacenter is located in the basement. As a matter of principle, concerning the hydrological situation, there is actually nothing to worry about, but it is still unusual. Diesel generators are located on the fifth floor of the business-center building above the basement DC. Designers explain it simply: there is no other space to place diesel generator. That is not all: ibid, on the fifth floor, there is a tank for fuel reserves for diesel generator. Only 70 tons of diesel fuel under the roof, only 70 tons A rare and nice solution - a separate room with a bank safe door to store critical alienated data copies. Looks like a real bank vault. As they say, for refined customers. Eaton factory Eaton Company is a large multinational corporation with a century of history; it is known on the Russian market mainly for its solutions in the field of electrical engineering. Today, there are more than 100 thousand employees worldwide. $ 22 billion turnover in 2013 was achieved through sales in 175 countries.
2 Site s representative figuratively described the production of the UPS: they could be put in a line from the plant to the boundaries of Helsinki. For reference: The factory is located 20 km from the city. Expedition participants were taken on a tour around the production site to demonstrate the potential of Eaton s new technology in managing modules and two UPS assembly stations intermediate and final. Production site - site of increased danger: Smoking is not allowed even on the street, on the territory outside the building It is only allowed to be inside wearing the protective gear everyone was made to wear bright yellow jackets and fasten them to all buttons, on the legs - special rubber boots with heavy metal inserts, and the eyes were protected by special goggles It is only allowed to move around the site in small groups accompanied by several employees of the plant, walking literally on the tracks - on marked paths. The origin of the components used in Eaton UPS was not disclosed. In response to such questions "guides" said the same thing: We are a global company operating throughout the world; we do not know where some components are produced, but it does not matter, they are all - Eaton. What was appealing and startling at the factory: Perfect order everything is where it is supposed be, everything is fixed and signed Cleanness, smooth and comfortable lighting, fresh air Amazing ergonomics of the workplaces - everything is at hand: tools, equipment, parts, documents
3 Detailed and visual technological cards for the staff: at eye level above the desk - stand with instructions; visual instructions - with diagrams, photographs, explanations; technological cards have time regulations. Vladimir Demidov, head of complex projects and datacenters, Eaton's Electrical Engineering Sector «The expedition to Scandinavia was a great opportunity to show Eaton s UPS production site to the participants. Factory in the city of Espoo is rightly called a center of advanced technology in the field of large UPS system production - for 50 years the plant has made more than 250,000 UPS for its customers. Besides, the participants were able to learn more about other Eaton s solutions for DC segment, in particular, about switchgear of low or medium voltage, which have already proven themselves in the industry and are reliable, compact and of high performance.» Marika Sinikari, Marketing Communications Manager, Eaton Electrical EMEA, Power Quality and Electronics. "Eaton s team of some 20 data center professionals welcomed the Russian customers for a two-hour visit starting with welcome words by Kari Koli, Sales Manager Russia and Central Eastern Europe and continuing to a presentation of the latest paper by Technology Manager Janne Paananen on The evolution of a resilient power chain in a data center. Vladimir Demidov, Senior Sales Representative LSG/Data Centers, Eaton Russia and Oleg Tatianin, Sales Supervisor, Electrical Contractors and System Integrators Channel, Eaton Russia introduced the Eaton data center offering in Russia and then took the group into the factory for a tour to showcase the new Power Xpert 9395P product and a live UPS demo". Kajaani, Finland Kajaani is a small town by Russian standards: only 30 thousand residents. It is strictly north of Helsinki, about 600 km. However, on the Finnish scale (for a population of just over five million) is does not seem that small. There is a university of applied sciences with 2000 students. Not so long ago, there was the first graduation of Master students with a specialization in data centers. Kajaani Airport amazed and delighted the group. Small, extremely clean and functional everything is thought through, everything is provided, everything is in right place. In 1998 and 1999 it was recognized as the best airport in Finland. Of course, cleanliness and silence can be explained by loose flight schedule and small size of the aircrafts. Renforsin Ranta Business Park Until 2008, Kajaani paper mill was one of the key factories in town. It was owned by an international company United Paper Mills (UPM) with EUR 10 bn turnover and more than 20 thousand employees. UPM closed part of its PPM around the world, including three factories in Finland one of them being in Kajaani. In 2008, Renforsin Ranta business park was opened on the territory of closed paper factory. Today there are 34 companies located in the business park, employing more than 600 people. The main industries are engineering, design, automation and information technology. The size of the business park hectares, it consists of 18 buildings with a total area of sq. m. More than sq. m. usable space of Renforsin Ranta is rented by two "anchor" companies: CSC and Herman IT, which are developing datacenters services in the business park. Renforsin Ranta area has unique characteristics to place data centers: connected electric power MW, which can easily be increased to 900 (!) MW.
4 Half of energy is generated with zero carbon emissions, i.e. is environmentally friendly. Electric power is supplied to the site via five reserved lines - from five independent sources of generation: four national grid lines (part of FinGrid system) and a local hydropower plant. Part of power plants supplying the business park with energy is running on biofuel. Absolutely unique situation, from the Russian perspective: five independent sources of power supply - no channels, namely sources. This explains the fact that the concept of "system of guaranteed power", which implies the presence of diesel generator sets, is not applicable for the business park. During the dialogue with representatives of the business park owner, this somewhat humorous formula appeared: "The business park is supplied by energy via 4 lines and one backup power station." This is one of the greatest revelations from visiting the business park Renforsin Ranta. On the territory of the business park there is own pumping station providing water supply of 3 cu. m. per second via two independent routes. The number and characteristics of the communication channels were not disclosed, but it was stated that there is a direct channel to Russia. Sergey Fomichev, Business Development Director "Mastertel", Moscow to me people.» «A month ago I was talking to my old friend, neither from IT nor from telecom, and quite by chance the conversation turned into discussion about how many new people appear in our lives apart from business contacts. How often do we meet interesting people who you can talk to not only "about business", but also everything else, ranging from quantum physics to something more personal? I am glad that, thanks to the DCExpedition, I meet really interesting; emotionally, intellectually and spiritually close Aleksandr Pashnin, Head of the Department of Design "T-Platforms", Moscow «First of all, I would like to note the constructive and meaningful dialogues with representatives of the Finnish ICT sector, which hopefully will lead to further development of joint business of our company with current as well as new Scandinavian partners. Unconstructive approach of the Swedish side to development of interpersonal relationships was upsetting. I would like to thank the organizers of the tour for the high level of tour organisation, note the hospitality and openness of the Finnish colleagues, and also express gratitude to all participants of DCExpedition» Igor Dorofeev, CEO icord, Moscow «One of the main purposes of such visits is the possibility to understand an alternative approach to dc build, destroy clichés and stereotypes and also trace how initial data and possibilities, different from Russian, are transformed into practical solutions.» Fedor Klimenko, CEO GreenMDC, Saint-Petersburg «I loved the expedition. I always wanted to look at the foreign data centers and did not miss this opportunity, especially in such a good company. It is a pity that the political situation affects the communication between engineers from different countries, the refusal to visit the data center in Stockholm - another proof.
5 Nevertheless, the trip was great - I saw a lot of interesting things. Thanks to the organizers of the tour.» Datacenter CSC DATACENTER KAJAANI. CSC - is a state-owned company, established by the Finnish Ministry of Education and Science for researches and their support. The company employs 260 people, of whom seven are based in Kajaani. CSC datacenter occupies area of 3000 sq. m. in the Renforsin Ranta business park. It was built using modular technology. Free cooling system (water plus air). Data Center was established in 2012, and the Finns consider it as the most environmentally friendly DC in the world, referring to the PUE 1,06. The services include colocation, servers rent, Iaas. Cloud service is based on OpenStack solutions. The site is connected to the Finnish national data network FUNET. Information security of CSC datacenter was confirmed in 2013 with ISO 27001:2005 standard. Among the users of the data center there are 700 external projects, 4250 hosts. In million logins were recorded in dc systems. Three Finnish supercomputers can be referred to particularly interesting objects, placed in DC CSC: SISU, TAITO and BULL. Supercomputer SISU («sisu» means "will power") - a supercomputer Cray XC30 with stunning power characteristics: 40,608 cores 3384 processor Intel Xeon E5-2690v3 on 1692 nodes; 64 GB of memory on each node, the total amount of memory terabytes. All modules Cray XC30 are connected by highperformance channel with a capacity of 7 Tbit /s. With such characteristics and peak performance of 1.7 Pflops, SISU takes 30th place in the world ranking of supercomputers. Load of the supercomputer SISU ranges from 50 to 90%. Supercomputer s availability is accessible to everyone on CSC s webpage. Power consumption of SISU is 745 kw. Supercomputer is run by two operators working in shifts, but not around the clock. One of the operators - a serious looking Finnish girl with purple hair Susanna answered the questions of the participants of the expedition. Susanna studied at Cray Inc. in order to cope with such a demanding task of running a supercomputer. Two other supercomputers do not impress by their characteristics, but are worth mentioning. Supercomputer TAITO has 9216 cores on 1153 processors in the 576 servers HP Proliant SL230s and 64 GB per node. BULL supercomputer commissioned in August Its performance at the peak reaches 270 teraflops. Computing subsystem is based on the processor Intel Xeon PLi 7170x and NVidia Tesla. There is one remarkable fact about BULL s engineering - it has water cooling using hot water. DATA CENTER IBM / HERMAN IT. The second data center, located in Renforsin Ranta business park, owned by Herman IT - KPO Group member, which has more than 100 years of experience in the telecommunication business. Herman IT provides colocation services. Data center in Renforsin Ranta was established in 2012 in collaboration with IBM, who conducted a risk assessment. Infrastructure design and implementation is based on IBM Enterprise Modular Data Center solution (EMDC) - traditional modular solution for data centers. According to Herman IT, data center has a PUE ratio of and the most reliable infrastructure in Finland. The overall level of reliability is estimated at %, reliability of the power supply - 100% for local sources, % for the rest.
6 Herman IT data center has been certified in compliance with the IBM Level 3+ for Infrastructure, which, according to company managers, is even slightly higher than Tier 4 level of TIA-942 standard. While designing a DC particular attention was paid to assessing the risks that were investigated using the Ramentor ELMAS tools developed by Finnish software and consulting company. Risks were assessed throughout the life cycle of the datacenter, from designing to operation. Ilmari Vallo, Managing Director, DataCenter Finland «We were delighted to receive this significant group of Russian business decision makers as our guests to Helsinki, Finland to DataCenter Finland s modern and hightechnology datacenter. This short visit was more than just a short visit; it created the basis of business relationships with interesting people from interesting companies. It s our pleasure to continue discussions with these guests and see what future opportunities we might have together». Jani Moilanen, Business Development Director, Herman IT «I saw a group of DC professionals that were very interested in exploring the best practices used in different environments and data center solutions. The main discussion topics were reliability, efficient operations and green initiatives. From our company perspective, we see value in this kind of networking where we can collectively discuss with DC professionals and share the best practices». Carl Wideman, ICT-cluster director, DIGITICE «It was a pleasure to meet the group, it's clear we share common challenges and objectives and we plan to bring solid answers to the key questions we explored, to Moscow in the spring of We very much hope that DC MAGAZINE will join us to further develop our relationship. Will we guarantee powerdelivery? May be a discussion point» Fly in the ointment: The Russians are coming. They re right around. I ve seen Russian soldiers! More than 65 years ago, at the very beginning of the lingering Cold War, James Forrestal, US Defense Minister committed suicide in the psychiatric ward of the National Naval Medical Center. There were rumors that during his mental illness he was raving, repeating the same phrase over and over again: "The Russians are coming. They're right around. I've seen Russian soldiers! "It would seem that the time of McCarthyism and "witch hunts" are in the past and it is difficult to relate the story of James Forrestal to the current situation. Not at all. Just one day before the scheduled Bahnhof datacenter visit in Stockholm, the organizers of the tour received a letter from the manager of the datacenter, Mr. Karlung. It was not just a letter, but a press release in Swedish, designed in the style of the above-cited story. Mr. Karlung, confusing red with square, called the tour participants "senior IT managers," praised to the skies the technical solutions of his datacenter, highlighted its advanced nature and uniqueness, referred to Russian aggression and rejected the dc visit. Pathetic PR and vain attempt to disrupt the tour. Such a nervous decision of Mr. Karlung did not spoil any impressions of the trip, but only increased openness and hospitality of our Finnish colleagues, who superlatively did everything to prove: business
7 is done among people, not by companies or countries, and contacts among people should not depend on government politics. Concerning Mr. Karlung, we wish him sound health and a long life in a bunker of cold war times, in which his datacenter is actually located. Mr. Karlung is in a safe base. We do not doubt it.