RED HAT DEVELOPER TOOLSET Build, Run, & Analyze Applications On Multiple Versions of Red Hat Enterprise Linux

Transcription

1 RED HAT DEVELOPER TOOLSET Build, Run, & Analyze Applications On Multiple Versions of Red Hat Enterprise Linux Dr. Matt Newsome Senior Engineering Manager, Tools

2

3

4 RED HAT ENTERPRISE LINUX RED HAT DEVELOPER TOOLSET YOUR QUESTIONS bit.ly/dtstalk

5 RED HAT DEVELOPER TOOLSET v2.1: Released 12th March 2014

6 RED HAT ENTERPRISE LINUX TOOLS

7 Toolchain Support RHEL 5 RHEL 6 10 YEARS OF SUPPORT RHEL 7 Beta Fedora VERY HIGH STABILITY LIMITED NEW FEATURES 7

8 Building with RHEL tools (1) Application Sources BUILD Branched Sources BUILD gcc x gcc y DEPLOY DEPLOY RHEL 5 RHEL 6

9 Building with RHEL tools (2) Application Sources x.1 BUILD Sources x.2 gcc x.2 Sources y.2 Sources y.3 BUILD gcc y.1 gcc y.2 gcc y.3 RHEL 5.y RHEL 5.y+1 gcc x.3 Sources x.3 Application Sources y.1 gcc x.1 DEPLOY RHEL 5.y+2 DEPLOY RHEL 6.y RHEL 6.y+1 RHEL 6.y+2

10 Ideal Scenario RHEL 5 (all supported minor releases) Sources Build Latest Tools Test & Deploy RHEL 6 (all supported minor releases)

11 RED HAT DEVELOPER TOOLSET

12 What is Red Hat Developer Toolset? The latest stable tools for developers (Compiler, IDE, performance and version control tools) An extra set - does not replace your existing RHEL tools Tools run on RHEL 5 & 6 RHEL 5 RHEL 6 RHEL 7 Beta Applications built with Developer Toolset also run on RHEL 5 & 6 Applications built with Developer Toolset 2.1 today on RHEL 6 also run on RHEL 7 Beta Available through Developer Subscriptions and Partner Programs v2.1 GA available today

13 Supported Architectures and Languages EL RHEL RHEL 5&6 IA-32 x86-64 C, C++ & Fortran SOFTWARE COLLECTIONS

14 SOFTWARE COLLECTIONS Structure for delivering software outside OS /opt (per Filesystem Hierarchy Standard) Different filesystem root per application version Activated via script Allows multiple versions installed in parallel Independent lifecycle from RHEL

15 Developer Toolset is a Software Collection / usr gcc bin lib RHEL x.y System Compiler etc. libc.so Developer Toolset Compiler etc. opt rh dts-1.x root usr dts-2.x Separate tools, not default Lifecycle independent from RHEL root enable gcc etc. enable Special Invocation bin... Internal script invoked via scl utility

16 What s in Developer Toolset v2.1? CORE TOOLS GCC 4.8 ECLIPSE IDE GDB BINUTILS KEPLER (RHEL 6 ONLY) DEBUG & PERFORMANCE TOOLS SYSTEMTAP 2.1 OPROFILE VALGRIND DYNINST 8.0 STRACE 4.7 DWZ ELFUTILS VERSION CONTROL GIT MEMSTOMP SOFTWARE COLLECTIONS

17 What s in Developer Toolset v2.1? CORE TOOLS GCC 4.8 ECLIPSE IDE GDB BINUTILS SOFTWARE COLLECTIONS KEPLER (RHEL 6 ONLY) DEBUG & PERFORMANCE TOOLS SYSTEMTAP 2.1 OPROFILE VALGRIND DYNINST 8.0 STRACE 4.7 DWZ ELFUTILS VERSION CONTROL GIT MEMSTOMP KEY: UPDATED IN 2.1 NEW IN 2.1

18 Updated Compiler: GCC 4.8 C++11 LRA Performance HTM Leading C++11 language support Guaranteed atomic memory accesses Brand new Local Register Allocator Contributed by Red Hat Compile extremely large functions faster and using less memory Simpler concurrency Atomic execution of source instruction groups

19 Eclipse IDE v4.3.1 ( Kepler ) [RHEL6 only]

20 Developer Toolset Life Cycle ANNUAL RELEASE DRIVEN BY GCC SPRING SUMMER TOOLSET

21 Developer Toolset Life Cycle TOOLSET v1.x FIRST YEAR SECOND YEAR MID-YEAR v1.1 1.x CRITICAL FIXES AND SECURITY UPDATES 1.x END OF LIFE v1.0 TOOLSET v2.x Async updates MID-YEAR Mid-year minor v2.0 v2.1 2.x CRITICAL FIXES & SECURITY UPDATES 2.x END OF LIFE Annual major

22 PRACTICALITIES

23 Usage EITHER Subscription # rhn-channel --add --channel=rhel-x86_64-workstation-dts-6 # yum-config-manager --enable rhel-server-dts-6-rpms { } Installation # yum install devtoolset-2 Usage EITHER { scl enable devtoolset-2 'gcc...' Click the Developer Toolset Eclipse 2.x Eclipse icon Advanced scl enable devtoolset-2 'bash...' }

24 DEMONSTRATION

25 MEMSTOMP

26 memcpy() calls with overlapping arguments #include <string.h> main() { char src[] = "text-to-copy"; char *dest = src + 2; // call memcpy() with overlapping args memcpy((void*)dest,(void*)src,3); return 0; } [mattn@rhel]$ gcc memcpy_bad.c -o memcpy_bad [mattn@rhel]$./memcpy_bad Segmentation fault (core dumped)

27 memstomp to the rescue! memstomp./memcpy_bad memstomp: successfully initialized for process memcpy_bad (pid 28195). memcpy(dest=0x7fff103cc1c2, src=0x7fff103cc1c0, bytes=3) overlap for memcpy_bad(28195) /.../libmemstomp.so(+0x10a7) [0x7fdb4760a0a7]./memcpy_bad(main+0x45) [0x400795] /lib64/libc.so.6( libc_start_main+0xfd) [0x357fe1ed1d]./memcpy_bad() [0x400669] Indicates overlapping arguments to memcpy()...but also indicates where that call occurs

28 memcpy() calls with overlapping arguments fixed #include <string.h> main() { char src[] = "text-to-copy"; char *dest = src + 5; // no longer overlaps memcpy((void*)dest,(void*)src,3); return 0; } [mattn@rhel]$ gcc memcpy_fixed.c -o memcpy_fixed [mattn@rhel]$./memcpy_fixed [mattn@rhel]$ memstomp./memcpy_fixed memstomp: successfully initialized for process memcpy_fixed (pid 31322).

29 Fixing memcpy() calls The best way: fix memcpy() calls Alternative: replace memcpy() with memmove()

30 UNDER THE HOOD

31 Linkage RHEL glibc libgomp libstdc++ libgcc APPLICATION Dynamic Linkage Newer Symbols Static Linkage BUILD GCC 4.7 GCC 4.8 TOOLSET

32 Regular Linkage with RHEL Toolchain Traditional RHEL Application symbol symbol symbol symbol dynamic linkage libstdc++ (C++ Library) V2 glibc (C Library) libgcc (conversions, etc.) libgomp (OpenMP) Bugs in glibc can be fixed via errata updates to base Red Hat Enterprise Linux

33 Static Linkage of Newer Symbols Archive of newer libstdc++ symbols (.a) static linkage Application Built with Developer Toolset symbol symbol symbol symbol.o newer symbol.o newer symbol dynamic linkage v2 libstdc++ (C++ Library) v2 glibc (C Library) libgcc (conversions, etc.) Some DTS symbols are statically linked RHEL errata updates won't change your binaries libgomp (OpenMP)

34 Security Implications Archive of newer libstdc++ symbols (.a) REBUILD Application Built with Developer Toolset symbol symbol symbol symbol.o newer symbol.o newer symbol Statically linked symbols still contain bug Applications must be rebuilt to fix this Low Risk Alerts via Security Advisory

35 COMMON QUESTIONS

36 Common Questions (1) How do I make Developer Toolset gcc/gdb the default? scl enable devtoolset-2 'bash...' How do I use Developer Toolset gcc to...x? scl enable devtoolset-2 'X'

37 Common Questions (2) Which RHEL versions can I run toolset on? Which RHEL versions can I run toolset-built apps on?

38 Common Questions (3) Gotchas and issues? Release notes spell these out Main ones to be aware of C++11, TM are experimental, use with caution or use C++98 Some base RHEL errata are required for all features Forwards only (don't build on RHEL6 and run on RHEL5) Forwards only (don't build on rhel-6.5 and run on rhel-6.3) Intended for userland development, not kernel rebuilding

39 Common Questions (4) How can I download Red Hat Developer Toolset? Good question...

40 ACCESSING DEVELOPER TOOLSET

41 Access and Installation 1. Red Hat Enterprise Linux developer subscription

42 Obtaining Red Hat Developer Toolset Red Hat Developer Toolset March 2014 PROFESSIONAL ENTERPRISE RED HAT ENTERPRISE LINUX DEVELOPER SUBSCRIPTIONS RED HAT ENTERPRISE LINUX DEVELOPER WORKSTATION RED HAT ENTERPRISE LINUX DEVELOPER SUITE Available Only Self Support RED HAT ENTERPRISE LINUX NFR SUBSCRIPTIONS Available Only Self Support RED HAT ENTERPRISE LINUX ACADEMIC SITE SUBSCRIPTIONS Available Only Self Support

43 Access and Installation 1. Red Hat Enterprise Linux developer subscription 2. If using Satellite, generate a new certificate 3. Register your RHEL system 4. Attach a subscription 5. Add the channel [refer to release notes: red.ht/devtoolset] 6.yum install devtoolset 2

44 Links Developer Program Developer Toolset Documentation This talk/video:

45 Contacts General questions, thoughts, etc. Red Hat Developer Toolset Product Manager Brian Gollaher Engineering Lead Martha Benitez

46 YOUR QUESTIONS

47 THANK-YOU