Red Hat Platform Technologies Update. Christoph Doerbeck Principal Solutions Architech

Transcription

1 Red Hat Platform Technologies Update Christoph Doerbeck Principal Solutions Architech August 28, 2014

2 Current Release Milestones *** Subject to Change *** Released RHEL 7.0 RHEL 6.5 RHEL 5.10 MRG 2.4 (RHEL 6.x Realtime, Linux kernel) RHEV 3.4 Red Hat Storage 2.1 (Big Bend) Futures RHEL 5.11 Q (Currently in BETA) RHEL 6.6 Q (Currently in BETA) Red Hat Storage 2.2 2

3 Current Lifecycle Milestones Red Hat Enterprise Linux 4 End of Maintenance was March 31, 2012 RHEL 5 GA Date: March 14, 2007 End of Phase 1: Q4, 2012 End of Phase 2: Q1, 2014 End of Production: March 31, 2017 RHEL 6 GA Date: November 10, 2010 End of Phase 1: Q2, 2016 End of Phase 2: Q2, 2017 End of Production: November 30, 2020 RHEL 7 GA Date: June 10, 2014 End of Phase 1: Q4, 2019 End of Phase 2: Q4, 2020 End of Production: June 30,

4 Red Hat Enterprise Linux With call-outs for RHEL

5 RED HAT SOLUTIONS PaaS Management Systems Scale-Out, High-Performance Storage Software Physical Servers Virtual Servers Network & Storage Infrastructure Cloud Servers Open Hybrid Cloud SYSADMINS IT ADMINS Red Hat Enterprise Linux DEVELOPERS App Platforms / Messaging / Cache / Grid / SOA

6 RED HAT SOLUTIONS App Platforms / Messaging / Cache / Grid / SOA Management Systems PaaS RED HAT ENTERPRISE VIRTUALIZATION PaaS OpenStack Scale-Out, High-Performance Storage Software RED HAT NETWORK OpenHybrid Cloud SATELLITE JBOSS Operations Network Physical Servers Virtual Servers Network & Storage Infrastructure Cloud Servers SYSADMINS IT ADMINS RED HAT DEVELOPERS App Platforms / Messaging / Cache / Grid / SOA

7 THE CIO'S ALTERNATIVE MATRIX Microsoft Windows (with Hyper-V virtualization), Oracle Solaris, IBM AIX, HP/UX Red Hat Enterprise Linux VMware Cloud Foundry, Microsoft Azure, Google App Engine Red Hat OpenShift IaaS Cloud & Orchestration VMware vcloud Director, VMware Dynamic Ops Red Hat CloudForms, Open Stack, ManageIQ Virtualization VMware vsphere, Citrix XenServer, Microsoft HyperV Red Hat Enterprise Virtualization Operating System PaaS Cloud Storage NetApp, EMC Isilon (with embedded KVM virtualization) Red Hat Storage (previously known as Gluster) IBM WebSphere Application Server, VMWare ffabric tcserver, Oracle WebLogic Server JBoss Enterprise Application Platform IBM Websphere Portal Server, Liferay Portal Oracle WebCenter Portal JBoss Enterprise Portal Platform In Memory Data Grid IBM WebSphere extreme Scale, Oracle Coherence, VMware vfabric GemFire JBoss Data Grid Enterprise Service Bus (ESB) IBM WebSphere ESB & Message Broker, Oracle SOA Suite & ES, MuleSule ESB, Sonic ESB. Tibco ActiveMatrix JBoss Enterprise SOA Platform IBM InfoSphere Federation Server, Progress DataXend SI, Oracle Data Integration Suite, Composite Information Server JBoss Enterprise Data Services Platform IBM Operational Decision Manager & IBM Business Process Manager, Oracle BPM Suite, Pegasystems Business Rules, FICO Blaze Advisor JBoss Enterprise BRMS IBM WebSphereMQ, VMware vfabric RabbitMQ, Oracle AQ, Tibco EMS Red Hat MRG Messaging Application Server Portal / WCM Data Services Business Rules Messaging

8 Red Hat Platform Technologies Alternatives Matrix Operating System AIX, HP-UX, Solaris Red Hat Enterprise Linux (RHEL) Veritas Storage Foundation LVM Multi-Pathing EMC PowerPath DM Multi-Path HA Clustering Veritas Cluster Server & Cluster Filesystem Red Hat High Availability Add-On (Clustering, CLVM, GFS) Novell edirectory, Oracle Directory Server Red Hat Directory Server VMWare ESX & ESXi Red Hat Enterprise Linux & RHEV-H VMWare Vcenter Red Hat Enterprise Virtualzation Manager (RHEV-M) NAS (ex: EMC Isolon, NetApp) Red Hat Storage (Gluster) Storage Volume Management Directory Services Virtualization Hypervisor Virtualization Management Storage

9 Addressing Myths & Arguments facing Linux Migrations Scalability & QOS Concerns CPU & Memory Storage Resource Management RAS Concerns Hardware Failure Handling Hot Add & Remove Clustering Options Root Cause Analysis (Core Dumps & Tracing) Performance & Tuning Expertise & Training Existing Support Relationships (Bias) 9

10 Scalability RHEL 6 CPUs Memory File Systems Scalability

11 Performance RHEL 6 Network Filesystem Comparing RHEL5.5 Infiniband with RHEL6 10Gb with RoCE Messages/Sec Message Size (Bytes) RHEL5.5 Infiniband RHEL6 RoCE Geo Mean MB/sec (1k-1m,1g-4 g) RHEL6-B2 IOzone Dell 6800 LSI % gain Cache 17 % gain DIO RHEL5.5 ext3 35 % gain Out-Cache RHEL6.0 ext4 Power Consumption Power Consumption % Savings % Savings 60 36% Power Savings over RHEL RHEL 5.4 RHEL 5.5 RHEL 6 Idle power consumption (W), measured on Nehalem-EP Performance

12 TPC-H Performance

13 Storage - RHEL 6 Logical Volume Manager (LVM) Snapshot Merge RAID 4 5 & 6 Thin Provisioned LVs FcoE Target lvconvert merge snapshot into original volume RHEL 6.4 Restore previous (point in time) states of LVM. RAID 10 Max Tape Drives = 512 (was 128) Filesystems & Storage RHEL 6.3 Ext4 Default filesystem for RHEL6 Faster & more scalable (vs. ext3) Vastly improved fsck time (vs. ext3) XFS : for very large storage GFS : for clustered environments RHEL 6.5 lvmetad reduces lvm device scanning impact RHEL 6.3 GFS2 perf boost O_Direct in FUSE 13

14 Addressing RAS - RHEL 6 Root Cause Analysis Perf Analysis & Diagnostics Tuned, NUMAd Oprofile, SystemTap, Tuna Blktrace Memory demand & patrol scrubbing kexec/kdump, ABRT Pages declared poisoned (HWPoison), kills associated processes & avoids use in the future Machine Check Architecture Recovery (MCA) Intelligent recovery of CPU/Memory errors which traditionally result in down time. Enhanced error reporting for PCI devices (PCI-AER & APEI) RHEL 6.5 makedumpfile supports LZO compression. Improves performance.

15 RHEL 6 - Support for Xeon 7500 RAS Features New RAS Features in Xeon 7500/6500 RAS Feat ure Requires OS Support Recovery from Uncorrected Data Errors (MCA) OS CPU On-Lining OS Memory On-Lining (Capacity Change) DIMM Isolation Physical CPU Hot Add Transparent Memory Migration QPI Poisoning/Viral Mode CPU Sparing/Migration Direct Connect Flash Physical IOH Hot Add OS IOH On-Lining Scalable Memory Interconnect (SMI) Clock Failover Scalable Memory Interconnect (SMI) Lane Failover Scalable Memory Interconnect (SMI) Packet Retry QPI Clock Failover QPI CRC QPI Self-Healing QPI Packet Retry Single-Core Disable for Fault Resilient Boot On-Die Error Protection Out-of-Band Access to Uncore MCA Registers No No No No No No No No No No No No No No No Existing RAS Features in Xeon Architecture Memory Board Hot Add Memory Mirroring Intra- and Inter-Socket Memory Mirroring Static Hard Partitioning PCI Express Hot Plug Memory Demand and Patrol Scrubbing DIMM and Rank Sparing DRAM SDDC Support ed in RHEL 6

16 Resource Management RHEL 6 Control Groups Resource Management (CGroups) Dynamic allocation of: processes, memory, storage & network RHEL 6.3 Reduce resource contention Per Interface Network Priority (net_prio) Meet SLA's Increase predictability & performance.

17 Other noteworthy RHEL 6.4 Enhancements Virtualization VMWare PV Driver Updates network, storage, memory ballooning, mouse & video Additional Packages linuxptp Precision Time Protocol (PTP) cpupowerutils turbostat displays CSTATE information tuna graphical tool to manage processor affinity, numa, etc... hwloc tool to graph hardware layout perf advanced performance monitoring

18 Other noteworthy RHEL 6.5 Enhancements General CPU Hot Plugging for Linux Guests - hot plug & unplug supported with QEMU guest agent on Linux guests; CPUs can be enabled or disabled while the guest is running VMware Platform Drivers Updates - network para-virtualized driver updated to the latest upstream version. fsfreeze - command halts access to a file system on a disk. Designed to be used with hardware RAID devices, assisting in the creation of volume snapshots. lvmetad - daemon eliminates scanning all physical disk devices (by lvm commands) in the system by dynamically aggregating metadata information. Disabled by default. Additional Packages linuxptp Precision Time Protocol (PTP) full support including HW time stamping (bnx2x, tg3, e1000e, igb, ixgbe, and sfc).

19 Red Hat Enterprise Linux Planning for the Future

20 TOP KERNEL CORPORATE CONTRIBUTORS Corporate contributions to Linux (KERNEL ) ARM PARALLELS FUJITSU LINBIT NETAPP INKTANK STORAGE AMD THE LINUX FOUNDATION CISCO QUALCOMM RENESAS ELECTRONICS INGICS TECHNOLOGY FREESCALE NVIDIA BROADCOM ORACLE WOLFSON MICROELECTRONICS VISION ENGRAVING SYSTEMS GOOGLE SAMSUNG CONSULTANTS 2% IBM 4% SUSE 6% LINARO 8% TEXAS INSTRUMENTS 10% RED HAT PERCENT OF TOTAL CODE CHANGES INTEL 12% 'LONG TAIL' OF CONTRIBUTORS 0% COMPANY / ORGANIZATION * * The developers who are known to be doing this work on their own, with no financial contribution happening from any company' are not grouped together as 'None' and instead are considered part of the 'long tail,' as are contributors of academic or unknown sponsorship. PORTFOLIO REVIEW Source: The Linux Foundation Linux Kernel Development September 2013 (Pages 9)

21 RED HAT ENTERPRISE LINUX: MORE THAN A DECADE OF INNOVATION RED HAT ENTERPRISE LINUX 2.1 BRINGING LINUX AND OPEN SOURCE TO THE ENTERPRISE RED HAT ENTERPRISE LINUX 3 MULTI-ARCHITECTURE SUPPORT, MORE CHOICES WITH A FAMILY OF OFFERINGS 21 RED HAT ENTERPRISE LINUX 6 LINUX BECOMES MAINSTREAM FOR PHYSICAL, VIRTUAL, AND CLOUD RED HAT ENTERPRISE LINUX 4 DELIVERING RAS, STORAGE, MILITARY-GRADE SECURITY RED HAT ENTERPRISE LINUX 5 VIRTUALIZATION, STATELESS LINUX ANY APPLICATION, ANYWHERE, ANYTIME RED HAT ENTERPRISE LINUX 7 REDEFINING THE ENTERPRISE OS RED HAT ENTERPRISE LINUX 7 THE FOUNDATION FOR AN OPEN HYBRID CLOUD

22 FOUNDATION FOR OPEN HYBRID CLOUD PORTABILITY ACROSS PHYSICAL, VIRTUAL, PUBLIC & PRIVATE CLOUDS PORTFOLIO REVIEW

23 Red Hat Enterprise Linux 7: Hot Topics Architectures: x86-64, POWER, System 390 No 32-bit ISOs, 32-bit libraries available with multilib toolchain Systemd xfs ext2 & ext3 removed firewalld pnfs client Upgrade & rollback (snapshot & merge) PTP In place upgrade RHEL 6 -> RHEL 7 OpenLMI Linux Containers (Docker)

24 STABLE AND EFFICIENT FLEXIBLE RED HAT ENTERPRISE LINUX 7 HIGHLIGHTS LIGHTWEIGHT APPLICATION ISOLATION (LINUX CONTAINERS) WINDOWS INTEROPERABILITY SCALABLE FILE SYSTEMS OPTIMAL PERFORMANCE VIA PROFILES STREAMLINED INSTALLATION AND DEPLOYMENT SYSTEM MANAGEMENT VIA OPENLMI CERTAINTY OF MISSION-CRITICAL RELIABILITY AND MILITARY-GRADE SECURITY PORTFOLIO REVIEW

25 REDEFINING THE ENTERPRISE OS RED HAT ENTERPRISE LINUX 7 LIGHTWEIGHT PHYSICAL CONSISTENT VIRTUAL STANDARDIZED PRIVATE CLOUD PORTABLE PUBLIC CLOUD CONTAINERS LIGHTWEIGHT, SIMPLIFIED APPLICATION DELIVERY AND ISOLATION PORTFOLIO REVIEW

26 LINUX CONTAINERS Software packaging concept that typically includes an application and all of its runtime dependencies. Easy to deploy and portable across host systems Isolates applications on a host operating system. In RHEL, this is done through: CONTAINER APP LIBS Control Groups (cgroups) kernel namespaces HOST OS SELinux, svirt SERVER PORTFOLIO REVIEW

27 BENEFITS OF LINUX CONTAINERS PORTFOLIO REVIEW

28 CONTAINERS ENABLE CONTINUOUS DELIVERY HOST OS SERVER APP LIBS CONTAINER CONTAINER APP LIBS HOST OS DEVELOPMENT FOCUS SERVER OPERATIONS FOCUS CODE APPLICATIONS LIBRARIES AND OTHER DEPENDENCIES DATA STORE PORTFOLIO REVIEW HARDWARE OPERATING SYSTEM NETWORKING MONITORING

29 RED HAT ENTERPRISE LINUX ATOMIC HOST 1 Red Hat Enterprise Linux Atomic Host is not generally available. Visit for additional information. PORTFOLIO REVIEW

30 RED HAT ENTERPRISE LINUX ATOMIC HOST MINIMAL, SECURE FOOTPRINT CONTAINERS Minimal host provides just enough to support apps. RAPID PROVISIONING Apps can be provisioned and started in milliseconds. kernel systemd SELinux docker SIMPLIFIED MAINTENANCE Atomic updates are quick, reliable, and can be rolled back. 1 Red Hat Enterprise Linux Atomic Host is not generally available. Visit for additional information. PORTFOLIO REVIEW

31 PORTABILITY ACROSS THE OPEN HYBRID CLOUD PORTFOLIO REVIEW

32 WINDOWS INTEROPERABILITY VIA DIRECT INTEGRATION MICROSOFT ACTIVE DIRECTORY Windows Domain interoperability is what I am looking forward to. We have a large Windows domain with 10k Windows workstations and 1300 Windows servers. Being able to authenticate and interact with Active Directory is a very high priority for us. 1 Lynn Dixon, System Administrator, Mohawk Industries SSSD RHEL 1 Source: Research by TechValidate: PORTFOLIO REVIEW

33 WINDOWS INTEROPERABILITY VIA INDIRECT INTEGRATION IDENTITY MANAGEMENT MICROSOFT ACTIVE DIRECTORY ALLOWS FOR EASIER CENTRALIZED NATIVE LINUX MANAGEMENT OF MULTIPLE LINUX CLIENTS TRUST SSSD RHEL 1 Source: Research by TechValidate: PORTFOLIO REVIEW

34 CHOICE OF FILE SYSTEMS 500 MAXIMUM FILE SYSTEM SIZE (TB) 500 The default XFS filesystem is just great!! IT Specialist, US Federal Government RHEL RHEL 4 ext2/ RHEL 5 ext4 Btrfs2 RHEL 6 GFS2 1 XFS Source: Research by TechValidate: TVID: 6D2-C98-90F 2 Btrfs is available as a Technology Preview. Chart data source: PORTFOLIO REVIEW RHEL 7

35 PLATFORM OF CHOICE FOR PERFORMANCE BENCHMARKS Percent Using Red Hat Enterprise Linux Benchmark Publications Using Red Hat Enterprise Linux Over Past 24 Months Industry Benchmarks November November 2013 (As of November 11, 2013) 100% 80% 79% 79% 75% 67% 54% 60% 39% 40% 33% 20% 23% 21% 0% STAC (All) SPEC CPU2006 SPECvirt_sc2010 SPECvirt_sc2013 SPECjbb2013 TPC-H TPC-C SAP SD 2-Tier SPECjEnterprise2010 Benchmark Name Red Hat and OEM partners are actively participating in industry-standard benchmarks Red Hat Enterprise Linux (RHEL) leads on many key benchmarks RHEL has captured a predominant share of submissions across a wide range of workloads SPEC is a registered trademark of the Standard Performance Evaluation Corporation. For more information about SPEC and it's benchmarks see TPC, TPC Benchmark and TPC-C are trademarks of the Transaction Processing Performance Council (TPC). For more information see Performance is easily twice as fast under Red Hat Enterprise Linux. We also reduced our total hardware & operating system licensing costs by 25 percent. I d say that the case for Red Hat Enterprise Linux is an open and shut one. TIM NOLAN, manager, Linux Engineering PORTFOLIO REVIEW

36 PERFORMANCE ENHANCEMENTS WITH RED HAT ENTERPRISE LINUX 7 BUILT-IN PERFORMANCE PROFILES SIMPLIFY CONFIGURATION MONITORING WITH PERFORMANCE CO-PILOT AND THERMOSTAT PORTFOLIO REVIEW FINE-TUNE PERFORMANCE WITH ENHANCED TOOLING VIA TUNA AND TUNED

37 SOLID PERFORMANCE ACROSS WORKLOADS RHEL 7 VS RHEL 6.5 SOLID PERFORMANCE ACROSS WIDE RANGE OF WORKLOADS AND MULTIPLE GENERATIONS OF HARDWARE RHEL 6.5 NETWORK CPU ERP MEMORY OLTP ANALYTICS COMMERCIAL DB 140 NORMALIZED PERFORMANCE (%) RHEL 7 OLTP JAVA OPEN SOURCE DB SERVER SIDE PARITY + 1% + 2% + 8% + 10% + 11% + 13% + 25% 2 x Intel Xeon Processor 5600 series 4 x Intel Xeon E7 v2 family 2x Intel Core i5 family 2 x Intel Xeon Processor 5600 series 2 x Intel Xeon Processor 7500 series 2 x Intel Xeon Processor 5600 series 2 x Intel Xeon Processor 5600 series 4 x Intel Xeon Processor 7500 series PORTFOLIO REVIEW

38 OPTIMAL PERFORMANCE VIA PROFILES Optimal performance management via enhanced performance tuning at install, simplified instrumentation and tuning features, and performance monitoring tooling PERFORMANCE CO-PILOT (PCP) THERMOSTAT (FOR JVMs) PORTFOLIO REVIEW

39 EFFICIENT INSTALLATION AND DEPLOYMENT SPEED DEPLOYMENT WITH SERVER PROFILES IN-PLACE UPGRADES [6.X TO 7] PRIORITIZE CRITICAL SERVICES AT START-UP EASILY CREATE CUSTOM INSTALL IMAGES SAFELY ROLL-BACK DURING INSTALL DRAMATICALLY SPEED START-UP TIMES PORTFOLIO REVIEW

40 CENTRALIZED MANAGEMENT AND FASTER BOOT UP CENTRALLY MANAGE PROCESSES, SERVICES, SECURITY PRIORITIZE AND ORDER SERVICES AT START-UP With systemd we can eliminate so many homegrown in-house monitoring and daemon management tools. 1 Engineer, Small Business Computer Software Company 1 DRAMATICALLY SPEED START-UP TIMES COMPATABLE WITH EXISTING SCRIPTS (SYSV AND LSB) Systemd is my favorite feature so far. We deal with lots of init scripts currently; I m already seeing great improvements by switching most of them to systemd. 1 IT Architect, Medium Enterprise Media & Entertainment Company Source: Research by TechValidate: TVID: 6D2-C98-90F PORTFOLIO REVIEW

41 MANAGEABILITY WITH OPEN LMI Open standards-based management framework for low-level system configuration PYTHON SCRIPTS LMI SHELL Unified management tools and system-wide resource management allow users to streamline administration CUSTOM APPS JBOSS MANAGEMENT SYSTEM PYTHON C/C++ JAVA SHELL SCRIPTS CLI OpenLMI Client Interface Libraries OpenLMI Object Broker NETWORK MANAGED SYSTEMS STORAGE USERS SERVICES SECURITY PORTFOLIO REVIEW SOFTWARE SYSTEM CONFIG OTHER AGENTS MONITOR

42 EASE OF USE: CHOICE OF DESKTOPS 85% of surveyed IT organizations found it easy to use the new desktop in Red Hat Enterprise Linux 71. GNOME CLASSIC (DEFAULT) PRESERVES INVESTMENTS IN TRAINING WITH OPTION TO USE FAMILIAR LOOK-AND-FEEL 1 GNOME 3 (GNOME SHELL) ELEGANT AND INTUITIVE USER INTERFACE CENTERED AROUND END-USER PRODUCTIVITY KDE V4.10 GNOME ALTERNATIVE FOR USERS WHO PREFER KDE Survey of 308 users of Red Hat Enterprise Linux, TVID: B F1E PORTFOLIO REVIEW

43 RED HAT ENTERPRISE LINUX FAMILY PORTFOLIO REVIEW

44 Where to Look for Performance Results Transaction Processing Performance Council Standard Performance Evaluation Corporation SAP Standard Application Benchmarks Oracle Applications Standard Benchmark STAC Securities Technologies Analysis Center

45 Red Hat Performance R vs R6.4 (4 socket Intel) SPECjbb 2005 Multi-instance metal/virt now gains +9-14% Single degradation downto 1% Database MySQL performance gains +15% Single Instance Oracle < 3%

46 Intel CPU Compatibility Matrix E5-46xx v2 E slated for Q release E7-48xx v2 E7 slated for Q release

47 Realtime High resolution clocks Targets applications with deterministic latency requirements Specialized GUI tools provided for analysis and tuning Latency Tracer TUNA Red Hat Enterprise Messaging Realtime Grid 1.x (MRG) Specialized realtime kernel based on xxx Layers upon standard RHEL 5 Red Hat Enterprise Messaging Realtime Grid 2.x (MRG) Specialized realtime kernel based on xxx, xxx Layers upon standard RHEL 6

48 Realtime Illustrating determinism Red Hat Confidential 4

49 What does that mean statistically? Vanilla (500K samples) Min: 1 Max: Mean: Mode: 9.00 Median: 9.00 Std. Deviation: MRG RT (500K samples) Min: 4 Max: Mean: 8.34 Mode: 8.00 Median: 8.00 Std. Deviation:

50 Container Technology 4 Key Challenges Resource Management Process Isolation Security Management Tooling Process Isolation Security Resource Management Management 5

51 Namespaces SELinux Memory Network UTS hostname Net Mount User SELinux libvirt-lxc / Docker CPU Security Process Isolation CGroups Resource Management Cgroups PID Kernel Namespaces 4 Key Solutions IPC Container Technology Block I/O Management libvirt-lxc / docker 51

52 Final Thoughts

53 Red Hat Summit 2015 Boston, MA June

54 If you would like to learn more, visit : Christoph Doerbeck cdoerbec@redhat.com Principal Solutions Architect