SIMD Programming Manual for Linux and Windows

Transcription

1 Paul Cockshott and Kenneth Renfrew SIMD Programming Manual for Linux and Windows Springer

2 Contents List of Tables List of Figures List of Algorithms Introduction xvii xix xxiii xxv I SIMD Programming 1 Paul Cockshott 1 Computer Speed, Program Speed Clocks Width Instruction Speed Overhead Instructions Algorithm Complexity 8 2 SIMD Instruction-sets The SIMD Model The MMX Register Architecture MMX Data-types DNow! Cache Handling Cache Line Length and Prefetching Streaming SIMD Cache Optimisation The Motorola Altivec Architecture 22 3 SIMD Programming in Assembler and C Vectorising C Compilers Dead for Loop Elimination Loop Unrolling Direct Use of Assembler Code The Example Program Use of Assembler Intrinsics 27

3 vi Contents 3.4 Use of C++ Classes Use of the Nasm Assembler General Instruction Syntax Operand Forms Directives Linking and Object File Formats Summing a Vector Coordinate Transformations Using 3DNow! Coordinate Transformations Using SSE Instructions 44 4 Intel SIMD Instructions Types r shrl saturate Instructions ADDPS ADDSS ANDNPS ANDPS CMPPS CMPSS COMISS CVTPI2PS CVTPS2PI CVTTPS2PI CVTSI2SS CVTSS2SI CVTTSS2SI DIVPD DIVPS DIVSD DIVSS EMMS FXRSTOR FXSAVE MASKMOVQ MAXPD MAXPS MAXSD MAXSS MINPD MINPS MINSD MINSS MOVAPSJoad MOVAPS_store MOVDJoad 62

4 Contents vii MOVD-Store MOVDJoad_sse MOVD_store_sse MOVHLPS MOVHPSJoad MOVHPS-Store MOVLHPS MOVLPSJoad MOVLPS-Store MOVMSKPS MOVNTPS MOVNTQ MOVQJoad MOVQ-Store MOVSSJoad MOVSS_store MOVUPSJoad MOVUPS_store MULPD MULPS MULSD MULSS ORPS PACKSSDW PACKSSWB PACKUSWB PADDB PADDB_sse PADDW PADDW_sse PADDD PADDD_sse PADDQ PADDQ_sse PADDSB PADDSB_sse PADDUSB PADDUSB-Sse PAND PAND.sse PANDN PANDN_sse PAVGB PAVGB_sse PAVGW PAVGW_sse PCMPEQB PCMPEQB-Sse 77

5 viii Contents PCMPEQW PCMPEQW.sse "I* PCMPEQD PCMPEQD_sse PCMPGTB PCMPGTB_sse PCMPGTW PCMPGTW_sse PCMPGTD PCMPGTD_sse PEXTRW PEXTRW_sse PINSRW PMADDWD PMAXSW PMAXUB PMINSW PMINUB PMOVMSKB PMULHUW PMULHW PMULLW POR PREFETCHNTA PREFETCHTl PREFETCHTO PSADBW PSHUFD PSHUFW PSxxf PSUBx PSUBSx PSUBUSx PSWAPD PUNPCKHBW PUNPCKLBW PUNPCKHWD PUNPCKLWD PUNPCKHDQ PUNPCKLDQ PXOR RCPPS RCPSS RSQRTPS RSQRTSS SFENCE SQRTPS SQRTSS 95

6 Contents ix SUBPS 95 " SUBSS UNPCKHPS UNPCLPS XORPS 97 3DNOW Instructions FEMMS PF2ID PFACC PFADD PFCMPEQ PFCMPGT PFCMPGE PFMAX PFMIN PFMUL PFNACC PFPNACC PFRCP PFRCPIT PFSUB PFSUBR PI2FD PI2FW PREFETCH 105 II SIMD Programming Languages 107 Paul Cockshott Another Approach: Data Parallel Languages Operations on Whole Arrays Array Slicing Ill Conditional Operations Reduction Operations Data Reorganisation Design Goals Target Machines Backward Compatibility Expressive Power Run-time Efficiency 120 Basics of Vector Pascal Formating Rules Alphabet 121

7 Contents Reserved Words and Identifiers Character Case Spaces and Comments Semicolons Base Types Booleans Integer Numbers Real Numbers Characters and Strings Variables and Constants Declaration Order Constant Declarations Variable Declarations Assignment Predefined Types Expressions and Operators Arithmetic Operations on Boolean Values Equality Operators Ordered Comparison Matrix and Vector Operations Array Declarations Matrix and Vector Arithmetic Array Input/Output Array Slices Vector and Matrix Products Inner Product of Vectors Dot Product of Non-real Typed Vectors Matrix to Vector Product Data-flow Hazards Matrix to Matrix Multiplication Typography of Vector Pascal Programs 149 Algorithmic Features of Vector Pascal Conditional Evaluation Functions User-defined Functions Procedures Procedure ReadAndValidate Function H Function Log Branching Two-way Branches Multi-way Branches Unbounded Iteration While Repeat 160

8 Contents xi 8.5 Bounded Iteration For to For Downto Goto User-defined Types Scalar Types SUCC and PRED ORD Input/Output of Scalars Representation Sub-range Types Representation Dimensioned Numbers Arithmetic on Dimensioned Numbers Handling Different Units of Measurement Records Pointers Pointer Idioms Freeing Storage Set Types Set Literals Operations on Sets String Types Input and Output File Types Binary Files Text Files Operating System Files Output Binary File Output Text File Output Generic Array Output Input Generic Array Input Binary File Input Text File Input File Predicates Random Access to Files Seek filepos Untyped i/o Error Conditions Permutations and Polymorphism Array Reorganisation An Example 200

9 xii Contents Array Shifts Element Permutation Efficiency Considerations Dynamic Arrays Schematic Arrays Polymorphic Functions Multiple Uses of Parametric Units Function dategt 206 t III Programming Examples 209 Paul Cockshott 12 Advanced Set Programming Use of Sets to Find Prime Numbers Set Implementation Ordered Sets openfiles loadset Sets of Records Retrieval Operations Use of Sets in Text Indexing Constructing an Indexing Program dirlist: A Program for Traversing a Directory Tree intodir bloomfilter hashword setfilter testfilter The Main Program to Index Files processfile A Retrieval Program Parallel Image Processing Declaring an Image Data Type Brightness and Contrast Adjustment Efficiency in Image Code Image Filtering Blurring Sharpening Comparing Implementations genconv dup prev pm doedges freestore 242

10 L_ Contents xiii 13.5 Digital Half-toning Parallel Half-tone errordifuse Image Resizing Horizontal Resize Horizontal Interpolation Interpolate Vertically Displaying Images demoimg - An Example Image Display Program The Unit BMP Procedure initbmpheader Procedure storebmpfile Function loadbmpfile * Procedure adjustcontrast Procedure pconv Procedure convp Pattern Recognition and Image Compression Principles of Image Compression Data Compression in General Image Compression Vector Quantisation of Images Data Structures encode The K Means Algorithm Vector Quantisation of Colour Images D Graphics Mesh Representation linedemo: An Illustration of 3D Projection demo3d: Main Procedure of linedemo Viewing Matrices SDL Initialisation Create a Rotation Matrix Calculate x mod D Projection Entry Point to Line Drawing Bresenham Line Drawing Procedure Performance 292 IV VIPER 293 Ken Renfrew 16 Introduction to VIPER Rationale The Literate Programming Tool The Mathematical Syntax Converter 296

11 xiv Contents 16.2 A System Overview Which VIPER to Download? System Dependencies Installing Files Setting Up the Compiler Setting Up the System Setting System Dependencies Personal Set-up Dynamic Compiler Options VIPER Option Buttons Moving VIPER Programming with VIPER Single Files 303 f' Projects 304,, j ; '" Embedding MpjX in Vector Pascal 306 s # * Compiling Files in VIPER Compiling Single Files Compiling Projects Running Programs in VIPER Making VPT$t VPTftX Options VPMath ETEX in VIPER HTML in VIPER Writing Code to Generate Good VPTEX Use of Special Comments Use of Margin Comments Use of Ordinary Pascal Comments Levels of Detail Within Documentation Mathematical Translation: Motivation and Guidelines I4TEX Packages 313 Appendix A Compiler Porting Tools 315 A.1 Dependencies 315 A.2 Compiler Structure 316 A.2.1 Vectorisation 317 A.2.2 Porting Strategy 320 A.3 ILCG 321 A.4 Supported Types 321 A.4.1 Data Formats 321 A.4.2 Typed Formats 322 A.4.3 ref Types 322 A.5 Supported Operations 322 A.5.1 Type Casts 322 A.5.2 Arithmetic 322 A.5.3 Memory 322

12 Contents xv A.5.4 Assignment 323 A.5.5 Dereferencing 323 A.6 Machine Description 323 A.6.1 Registers 323 A.6.2 Register Sets 324 A.6.3 Register Arrays 324 A.6.4 Register Stacks 324 A.6.5 Instruction Formats 325 A.7 Grammar of ILCG 325 A.8 ILCG Grammar 326 A.8.1 Helpers 326 A.8.2 Tokens 327 A.8.3 Non-terminal Symbols 329 Appendix B Software Download 335 Appendix C Using the Command Line Compiler 337 C.I Invoking the Compiler 337 C.I.I Environment Variable 337 C.1.2 Compiler Options 337 C.1.3 Dependencies 338 C.2 Calling Conventions 338 C.3 Array Representation 341 C.3.1 Range Checking 341 References 343 Index 345