Java in High-Performance Computing

Transcription

1 Java in High-Performance Computing Dawid Weiss Carrot Search Institute of Computing Science, Poznan University of Technology GeeCon Poznań, 05/2010

2

3

4 Learn from the mistakes of others. You can t live long enough to make them all yourself. Eleanor Roosevelt

5

6 Talk outline What is High performance? What is Java? Measuring performance (benchmarking). HPPC library.

7 Talk outline What is High performance? What is Java? Measuring performance (benchmarking). HPPC library. Crosscutting: (un?)common pitfalls and performance killers. Some HotSpot internals.

8 Divide-and-conquer style algorithm for (Example e : examples) { e.hasquiz()? e.showquiz() : e.showcode(); e.explain(); e.deriveconclusions(); }

9

10 PART I High Performance Computing

11 High-performance computing (HPC) uses supercomputers and computer clusters to solve advanced computation problems. Wikipedia

12 Is Java faster than C/C++? The short answer is: it depends. Cliff Click

13 It s usually hard to make a fast program run faster.

14 It s usually hard to make a fast program run faster. It s easy to make a slow program run even slower.

15 It s usually hard to make a fast program run faster. It s easy to make a slow program run even slower. It s easy to make fast hardware run slow.

16 For now, HPC limited allowed computation time, constrained resources (hardware, memory).

17 For now, HPC limited allowed computation time, constrained resources (hardware, memory). Good HPC software no (obvious) flaws.

18 PART II What is Java? (Recall: Is Java faster than C/C++?)

19 Example 1 public void testsum1() { int sum = 0; for (int i = 0; i < COUNT; i++) sum += sum1(i, i); result = sum; } public void testsum2() { int sum = 0; for (int i = 0; i < COUNT; i++) sum += sum2(i, i); result = sum; }

20 Example 1 public void testsum1() { int sum = 0; for (int i = 0; i < COUNT; i++) sum += sum1(i, i); result = sum; } public void testsum2() { int sum = 0; for (int i = 0; i < COUNT; i++) sum += sum2(i, i); result = sum; } where the body of sum1 and sum2 sums arguments and returns the result and COUNT is significantly large...

21 sun VM sum1 sum2

22 VM sum1 sum2 sun

23 VM sum1 sum2 sun sun

24 VM sum1 sum2 sun sun sun

25 VM sum1 sum2 sun sun sun ibm-1.6.2

26 VM sum1 sum2 sun sun sun ibm jrockit

27 VM sum1 sum2 sun sun sun ibm jrockit harmony-r917296

28 VM sum1 sum2 sun sun sun ibm jrockit harmony-r (averages in sec., 10 measured rounds, 5 warmup, 64-bit Ubuntu, dual-core AMD Athlon 5200).

29 VM sum1 sum2 sum3 sum4 sun sun sun ibm jrockit harmony-r (averages in sec., 10 measured rounds, 5 warmup, 64-bit Ubuntu, dual-core AMD Athlon 5200).

30 int sum1(int a, int b) { return a + b; } Integer sum2(integer a, Integer b) { return a + b; } Integer sum2(integer a, Integer b) { return Integer.valueOf( a.intvalue() + b.intvalue()); }

31 int sum3(int... args) { int sum = 0; for (int i = 0; i < args.length; i++) sum += args[i]; return sum; } Integer sum4(integer... args) { int sum = 0; for (int i = 0; i < args.length; i++) { sum += args[i]; } return sum; } Integer sum4(integer [] args) { //... }

32 Conclusions Syntactic sugar may be costly. Primitive types are fast. Large differences between different VMs.

33

34 Example 2 Write once, run anywhere!

35

36

37

38 But it s the same VM!

39 It works on my machine!

40 private static boolean ready; public static void startthread() { new Thread() { public void run() { try { sleep(2000); } catch (Exception e) { /* ignore */ } System.out.println("Marking loop exit."); ready = true; } }.start(); } public static void main(string[] args) { startthread(); System.out.println("Entering the loop..."); while (!ready) { // Do nothing. } System.out.println("Done, I left the loop!"); }

41 while (!ready) { // Do nothing. }? boolean r = ready; while (!r) { // Do nothing. }

42 while (!ready) { // Do nothing. }? boolean r = ready; while (!r) { // Do nothing. } In most cases true, from a JMM perspective.

43 JVM Internals...

44

45

46

47 C1: fast not (much) optimization C2: slow(er) than C1 a lot of JMM-allowed optimizations

48 There are hundreds of JVM tuning/diagnostic switches.

49 My personal favorite:

50 Conclusions Bytecode is far from what is executed. A lot going on under the (VM) hood. Bad code may work, but will eventually crash. HotSpot-level optimizations are good.

51 Conclusions Bytecode is far from what is executed. A lot going on under the (VM) hood. Bad code may work, but will eventually crash. HotSpot-level optimizations are good. If there is a bug in the HotSpot compiler...

52

53

54

55 Any other diversifying factors?

56

57 J2ME more VM vendors, hardware diversity, software and hardware quirks.

58

59 Non-JVM target platforms Dalvik GWT IKVM

60

61 Conclusions There is no single Java performance model. Performance depends on the VM, environment, class library, hardware. Apply benchmark-and-correct cycle.

62 Benchmarking

63 Example 3 public void testsum1() { int sum = 0; for (int i = 0; i < COUNT; i++) sum += sum1(i, i); result = sum; } public void testsum1_2() { int sum = 0; for (int i = 0; i < COUNT; i++) sum += sum1(i, i); }

64 sun VM sum1 sum1_2

65 VM sum1 sum1_2 sun

66 VM sum1 sum1_2 sun

67 VM sum1 sum1_2 sun sun sun ibm jrockit harmony-r (averages in sec., 10 measured rounds, 5 warmup, 64-bit Ubuntu, dual-core AMD Athlon 5200).

68

69 java -server -XX:+PrintOptoAssembly -XX:+PrintCompilation...

70 java -server -XX:+PrintOptoAssembly -XX:+PrintCompilation... - method holder: com/dawidweiss/geecon2010/example03 - access: 0xc public - name: testsum1_ pushq rbp subq rsp, #16 # Create frame nop # nop for patch_verified_entry 016 addq rsp, 16 # Destroy frame popq rbp testl rax, [rip + #offset_to_poll_page] # Safepoint: poll for GC 021 ret

71 Conclusions Benchmarks must be executed to provide feedback. HotSpot is smart and effective at removing dead code.

72 Example public void testadd1() { int sum = 0; for (int i = 0; i < COUNT; i++) { sum += add1(i); } guard = sum; } public int add1(int i) { return i + 1; } Note add1 is virtual.

73 switch testadd1 -XX:+Inlining -XX:+PrintInlining XX:-Inlining? (averages in sec., 10 measured rounds, 5 warmup, 64-bit Ubuntu, dual-core AMD Athlon 5200, JRE 1.7b80-debug).

74 switch testadd1 -XX:+Inlining -XX:+PrintInlining XX:-Inlining 0.45 (averages in sec., 10 measured rounds, 5 warmup, 64-bit Ubuntu, dual-core AMD Athlon 5200, JRE 1.7b80-debug).

75 Most Java calls are monomorphic.

76 HotSpot adjusts to megamorphic calls automatically.

77 Example 5 abstract class Superclass { abstract int call(); } class Sub1 extends Superclass { int call() { return 1; } } class Sub2 extends Superclass { int call() { return 2; } } class Sub3 extends Superclass { int call() { return 3; } } Superclass[] mixed = initwithrandominstances(10000); Superclass[] solid = public void testmonomorphic() { int sum = 0; int m = solid.length; for (int i = 0; i < COUNT; i++) sum += solid[i % m].call(); guard = sum; public void testmegamorphic() { int sum = 0; int m = mixed.length; for (int i = 0; i < COUNT; i++) sum += mixed[i % m].call(); guard = sum; }

78 VM monomorphic megamorphic sun sun sun ibm jrockit harmony-r (averages in sec., 10 measured rounds, 5 warmup, 64-bit Ubuntu, dual-core AMD Athlon 5200).

79 Example public void testbitcount1() { int sum = 0; for (int i = 0; i < COUNT; i++) sum += Integer.bitCount(i); guard = sum; public void testbitcount2() { int sum = 0; for (int i = 0; i < COUNT; i++) sum += bitcount(i); guard = sum; } /* Copied from * {@link Integer#bitCount} */ static int bitcount(int i) { // HD, Figure 5-2 i = i - ((i >>> 1) & 0x ); i = (i & 0x ) + ((i >>> 2) & 0x ); i = (i + (i >>> 4)) & 0x0f0f0f0f; i = i + (i >>> 8); i = i + (i >>> 16); return i & 0x3f; }

80 VM testbitcount1 testbitcount2 sun sun b (averages in sec., 10 measured rounds, 5 warmup, 64-bit Ubuntu, dual-core AMD Athlon 5200).

81 VM testbitcount1 testbitcount2 sun sun b (averages in sec., 10 measured rounds, 5 warmup, 64-bit Ubuntu, dual-core AMD Athlon 5200). VM testbitcount1 testbitcount2 sun sun b (averages in sec., 10 measured rounds, 5 warmup, 64-bit Windows 7, Intel I7 860).

82 ... -XX:+PrintInlining...

83 ... -XX:+PrintInlining Inlining intrinsic _bitcount_i at bci:9 in..example06::testbitcount1 Inlining intrinsic _bitcount_i at bci:9 in..example06::testbitcount1 Inlining intrinsic _bitcount_i at bci:9 in..example06::testbitcount1 Example06.testBitCount1: [measured 10 out of 15 rounds] round: 0.07 [ ], round.gc: 0.00 [+- 9 com.dawidweiss.geecon2010.example06::bitcount inline 9 com.dawidweiss.geecon2010.example06::bitcount inline 9 com.dawidweiss.geecon2010.example06::bitcount inline (hot) Example06.testBitCount2: [measured 10 out of 15 rounds] round: 0.32 [ ], round.gc: 0.00 [ ]...

84 ... -XX:+PrintOptoAssembly...

85 ... -XX:+PrintOptoAssembly... {method} - klass: {other class} - method holder: com/dawidweiss/geecon2010/example06 - name: testbitcount1... 0c2 B13: # B12 B14 <- B8 B12 Loop: B13-B12 inner stride:... 0c2 movl R10, RDX # spill... 0e1 movl [rsp + #40], R11 # spill 0e6 popcnt R8, R8... 0f5 addl R9, #7 # int 0f9 popcnt R11, R11 0fe popcnt RCX, R9

86

87

88 Conclusions Benchmarks must be statistically sound. averages, variance, min, max, warm-up phase Account for HotSpot optimisations. Account for hardware differences. test-on-target Use domain data and real scenarios. Inspect suspicious output with debug JVM. See more: Cliff Click,

89 HPPC High Performance Primitive Collections

90 Motivation Primitive types: fast and memory-friendly. Optional assertions. Single-threaded. No fail-fast. Fast, fast, fast iterators, with no GC overhead. Open internals (explicit implementation). Programmers know what they re doing.

91 Why not JCF? public interface List<E> extends Collection<E> { boolean contains(object o); // [-] contract-enforced methods Iterator<E> iterator(); // [-] iterators over primitive types? Object[] toarray(); // [-] troublesome covariants...

92 Friendly Competition fastutil PCJ GNU Trove Apache Mahout (ported COLT) Apache Primitive Collections All of these have pros and cons and deal with JCF compatibility somehow.

93 Iterators in fastutil or PCJ interface IntIterator extends Iterator<Integer> { // Primitive-specific method int nextint(); }

94 Iterators in HPPC public final class IntCursor { public int index; public int value; } public class IntArrayList extends Iterable<IntCursor> { Iterator<IntCursor> iterator() {... } }

95 Iterating over list elements in HPPC for (IntCursor c : list) { System.out.println(c.index + ": " + c.value); }

96 Iterating over list elements in HPPC for (IntCursor c : list) { System.out.println(c.index + ": " + c.value); }...or list.foreach(new IntProcedure() { public void apply(int value) { System.out.println(value); } });

97 Iterating over list elements in HPPC for (IntCursor c : list) { System.out.println(c.index + ": " + c.value); }...or list.foreach(new IntProcedure() { public void apply(int value) { System.out.println(value); } });...or final int [] buffer = list.buffer; final int size = list.size(); for (int i = 0; i < size; i++) { System.out.println(i + ": " + buffer[i]); }

98 The fastest one?

99

100

101 What s in HPPC?

102

103 Open implementation is good.

104 /** * Applies a supplemental hash function to a given * hashcode, which defends against poor quality * hash functions. [...] */ static int hash(int h) { // This function ensures that hashcodes that differ only by // constant multiples at each bit position have a bounded // number of collisions (approximately 8 at default load factor). h ^= (h >>> 20) ^ (h >>> 12); return h ^ (h >>> 7) ^ (h >>> 4); } HashMap rehashes your (carefully crafted) hash code.

105 HPPC approach (example): public class LongIntOpenHashMap implements LongIntMap { //... public LongIntOpenHashMap(int initialcapacity, float loadfactor, LongHashFunction keyhashfunction, IntHashFunction valuehashfunction) { //... } Defaults: LongMurmurHash, IntHashFunction.

106 Example 7 Frequency count of character bigrams in a given text.

107 HPPC: final char [] CHARS = DATA; final IntIntOpenHashMap counts = new IntIntOpenHashMap(); for (int i = 0; i < CHARS.length - 1; i++) { counts.putoradd((chars[i] << 16 CHARS[i + 1]), 1, 1); } JCF, boxed integer types. final Integer currentcount = map.get(bigram); map.put(bigram, currentcount == null? 1 : currentcount + 1); JCF, with IntHolder (mutable value object). GNU Trove map.adjustorputvalue(bigram, 1, 1); fastutil, OpenHashMap and LinkedOpenHashMap map.put(bigram, map.get(bigram) + 1); PCJ, OpenHashMap and ChainedHashMap

108

109

110 Is Java faster than C/C++? The short answer is: it depends. Cliff Click

111 Example 8 The same algorithm for building a DFSA automaton accepting a set of strings. Input: strings, 158M of text.

112 Example 8 The same algorithm for building a DFSA automaton accepting a set of strings. Input: strings, 158M of text. real user sys gcc -O2 java 1.6.0_20-64

113 Example 8 The same algorithm for building a DFSA automaton accepting a set of strings. Input: strings, 158M of text. gcc -O2 real s user s sys 0.240s java 1.6.0_20-64

114 Example 8 The same algorithm for building a DFSA automaton accepting a set of strings. Input: strings, 158M of text. gcc -O2 java 1.6.0_20-64 real s s user s s sys 0.240s 0.840s

115 Summary and Conclusions

116 Performance checklist (sanity check) Algorithms, algorithms, algorithms. Proper data structures. Spurious GC activity. Memory barriers in tight loops. CPU cache utilization. Low-level, hotspot-specific code structuring.

117 HPPC and junit-benchmarks are at: