Introduction to Electrical and Computer Engineering

Transcription

1 Introduction to Electrical and Computer Engineering Christopher Batten Computer Systems Laboratory School of Electrical and Computer Engineering Cornell University ENGRG 1060 Explorations in Engineering Seminar Summer 2012

2 ECE Overview What is Computer Engineering? Trends in Computer Engineering Computer Engineering Design ower Systems Computer Engineering Electrical Circuits Electrical Devices Signal rocessing Telecomm ENGRG 1060 Intro to ECE Christopher Batten 2 / 42

3 ECE Overview What is Computer Engineering? Trends in Computer Engineering Computer Engineering Design ECE is the Study and Application of Electricity, icro-electronics, and Electro-agnetism Smart Grid and Smart Buildings Atmospheric Science Telecomm Information Theory Network rotocols and Optimization Image, Audio, Video rocessing Signal rocessing ower Systems ECE Fusion and lasma hysics Control Theory Computer Engineering Electrical Circuits Robotics Computer-Aided Design Analog and Digital Circuits Opto-Electrical Devices icro-electro-echanical Devices Electrical Devices Bio-Electrical Engineering Systems and Synthetic Biology ENGRG 1060 Intro to ECE Christopher Batten 3 / 42

4 ECE Overview What is Computer Engineering? Trends in Computer Engineering Computer Engineering Design ECE is everywhere! Data Centers Game Consoles Computing: From Handhelds to Servers Electric and Hybrid Vehicles Digital Cameras Internet Routers GS Devices and Satellites Humanoid Robots Unmanned Vehicles Automobiles Fiber Optic Networks edical Imaging ortable edical Devices Solar anels ENGRG 1060 Intro to ECE Christopher Batten 4 / 42

5 ECE Overview What is Computer Engineering? Trends in Computer Engineering Computer Engineering Design What can one do with a background in ECE? ECE Industry: Intel, AD, Analog Devices, NVIDIA, H, Apple General Engineering Industry: GE, Lockheed artin, Raytheon Software Industry: icrosoft, Amazon, athworks Join a Startup: Achronix, Hillcrest Labs Research Lab: Sandia National Labs, Draper Labs, NASA Consulting: ckinsey, Accenture, Deloitte, Booz Allen Hamilton Finance: Deutsche Bank, Capital One, UBS, Bloomberg Graduate School: Law School, Business School, ed School Found a university! ENGRG 1060 Intro to ECE Christopher Batten 5 / 42

6 ECE Overview What is Computer Engineering? Trends in Computer Engineering Computer Engineering Design Cornell was founded because of ECE! Samuel orse invented the telegraph (a digital communication device), but needed help building the network Ezra Cornell built the first telegraph line (the beginning of telecommunications), and invested in the Western Union Telegraph Co "What hath God wrought?" Ezra Cornell s investments created the fortune that eventually enabled the founding of Cornell University ENGRG 1060 Intro to ECE Christopher Batten 6 / 42

7 ECE Overview What is Computer Engineering? Trends in Computer Engineering Computer Engineering Design Optional Homework Visit the statue of Ezra Cornell on the Arts Quad Does something on the back of the statue relate to ECE? Take a picture with your cellphone and send it to your friend! ower systems Computer engineering Electrical circuits Electrical devices Signal processing Telecommunications ENGRG 1060 Intro to ECE Christopher Batten 7 / 42

8 ECE Overview What is Computer Engineering? Trends in Computer Engineering Computer Engineering Design Talk Outline ECE Overview What is Computer Engineering? Trends in Computer Engineering Computer Engineering Design ENGRG 1060 Intro to ECE Christopher Batten 8 / 42

9 ECE Overview What is Computer Engineering? Trends in Computer Engineering Computer Engineering Design Computer Engineering Artifacts ENGRG 1060 Intro to ECE Christopher Batten 9 / 42

10 ECE Overview What is Computer Engineering? Trends in Computer Engineering Computer Engineering Design The Computer Systems Stack Application Gap too large to bridge in one step (but there are exceptions, e.g., a magnetic compass) Technology In its broadest definition, computer system design is the development of the abstraction/implementation layers that allow us to execute information processing applications efficiently using available manufacturing technologies ENGRG 1060 Intro to ECE Christopher Batten 10 / 42

11 ECE Overview What is Computer Engineering? Trends in Computer Engineering Computer Engineering Design The Computer Systems Stack Computer Engineering Application Algorithm rogramming Language Operating System Instruction Set Architecture icroarchitecture Register-Transfer Level Gate Level Circuits Devices Technology Sort an array of numbers 2,6,3,8,4,5 -> 2,3,4,5,6,8 Insertion sort algorithm 1. Find minimum number in input array 2. ove minimum number into output array 3. Repeat steps 1 and 2 until finished C implementation of insertion sort void isort( int b[], int a[], int n ) { for ( int idx, k = 0; k < n; k++ ) { int min = 99 for ( int i = 0; i < n; i++ ) { if ( a[i] < min ) { min = a[i]; idx = i; } } b[k] = min; a[idx] = 99; } } ENGRG 1060 Intro to ECE Christopher Batten 10 / 42

12 ECE Overview What is Computer Engineering? Trends in Computer Engineering Computer Engineering Design The Computer Systems Stack Computer Engineering Application Algorithm rogramming Language Operating System Instruction Set Architecture icroarchitecture Register-Transfer Level Gate Level Circuits Devices Technology ac OS X, Windows, Linux Handles low-level hardware management IS32 Instruction Set Instructions that machine executes blez $a2, done move $a7, $zero li $t4, 99 move $a4, $a1 move $v1, $zero li $a3, 99 lw $a5, 0($a4) addiu $a4, $a4, 4 slt $a6, $a5, $a3 movn $v0, $v1, $a6 addiu $v1, $v1, 1 movn $a3, $a5, $a6 ENGRG 1060 Intro to ECE Christopher Batten 10 / 42

13 ECE Overview What is Computer Engineering? Trends in Computer Engineering Computer Engineering Design The Computer Systems Stack Computer Engineering Application Algorithm rogramming Language Operating System Instruction Set Architecture icroarchitecture Register-Transfer Level Gate Level Circuits Devices Technology How data flows through system Boolean logic gates and functions Combining devices to do useful work Transistors and wires Silicon process technology Si Si Si Si Si Si ENGRG 1060 Intro to ECE Christopher Batten 10 / 42

14 ECE Overview What is Computer Engineering? Trends in Computer Engineering Computer Engineering Design Computer Systems: CS vs. EE vs. CE Computer Engineering Application Algorithm rogramming Language Operating System Instruction Set Architecture icroarchitecture Register-Transfer Level Gate Level Circuits Devices Technology Traditional Computer Science Computer Engineering is at the interface between hardware and software and considers the entire system Traditional Electrical Engineering ENGRG 1060 Intro to ECE Christopher Batten 11 / 42

15 ECE Overview What is Computer Engineering? Trends in Computer Engineering Computer Engineering Design ENGRG 1060 Computer Systems Labs Computer Engineering Application Algorithm rogramming Language Operating System Instruction Set Architecture icroarchitecture Register-Transfer Level Gate Level Circuits Devices Technology Lab 4 Software pushing towards hardware (CS,CE) Lab 2 Hardware pushing towards software (EE,CE) ENGRG 1060 Intro to ECE Christopher Batten 12 / 42

16 ECE Overview What is Computer Engineering? Trends in Computer Engineering Computer Engineering Design Application Requirements vs. Technology Constraints Computer Engineering Application Algorithm rogramming Language Operating System Instruction Set Architecture icroarchitecture Register-Transfer Level Gate Level Circuits Devices Technology Application Requirements Suggest how to improve architecture rovide revenue to fund development Computer engineers provide feedback to guide application and technology research directions Technology Constraints Restrict what can be done efficiently New technologies make new arch possible In its broadest definition, computer system design is the development of the abstraction/implementation layers that allow us to execute information processing applications efficiently using available manufacturing technologies ENGRG 1060 Intro to ECE Christopher Batten 13 / 42

17 ECE Overview What is Computer Engineering? Trends in Computer Engineering Computer Engineering Design rocessors, emories, and Networks Computer Engineering Application Algorithm rogramming Language Operating System Instruction Set Architecture icroarchitecture Register-Transfer Level Gate Level Circuits Devices Technology Input Data rocessor Network emory Output Data Compute data ove data Store data Computer engineering basic building blocks rocessors for computation emories for storage Networks for communication ENGRG 1060 Intro to ECE Christopher Batten 14 / 42

18 ECE Overview What is Computer Engineering? Trends in Computer Engineering Computer Engineering Design Activity #1: Sorting with a Sequential rocessor Application: Sort 32 numbers Simulated Sequential Computing System rocessor: You! emory: Worksheet, read input data, write output data Network: assing/collecting the worksheets Activity Steps 1. Discuss strategy with neighbors 2. When instructor starts timer, flip over worksheet 3. Sort 32 numbers as fast as possible 4. Lookup when completed and write time on worksheet 5. Raise hand 6. When everyone is finished, then analyze data rocessor Network emory ENGRG 1060 Intro to ECE Christopher Batten 15 / 42

19 ECE Overview What is Computer Engineering? Trends in Computer Engineering Computer Engineering Design Talk Outline ECE Overview What is Computer Engineering? Trends in Computer Engineering Computer Engineering Design ENGRG 1060 Intro to ECE Christopher Batten 16 / 42

20 ECE Overview What is Computer Engineering? Trends in Computer Engineering Computer Engineering Design Application Requirements vs. Technology Constraints Computer Engineering Application Algorithm rogramming Language Operating System Instruction Set Architecture icroarchitecture Register-Transfer Level Gate Level Circuits Devices Technology Traditional Application Requirements As much processor compute as possible As much memory capacity as possible As much network bandwidth as possible Traditional Technology Constraints Exponential scaling of resources ENGRG 1060 Intro to ECE Christopher Batten 17 / 42

21 ECE Overview What is Computer Engineering? Trends in Computer Engineering Computer Engineering Design Exponential Scaling for rocessor Computation Transistors (Thousands) DEC Alpha IS R2K Intel entium 4 Sequential rocessor erformance Frequency (Hz) Typical ower (Watts) Data partially collected by. Horowitz, F. Labonte, O. Shacham, K. Olukotun, L. Hammond ENGRG 1060 Intro to ECE Christopher Batten 18 / 42

22 ECE Overview What is Computer Engineering? Trends in Computer Engineering Computer Engineering Design Exponential Scaling for emory Capacity Adapted from [Itoh 07] ENGRG 1060 Intro to ECE Christopher Batten 19 / 42

23 ECE Overview What is Computer Engineering? Trends in Computer Engineering Computer Engineering Design Exponential Scaling for Network Bandwidth Network eak Bisection Bandwidth (B/s) ulti-stage Interconnection Networks ( 's Nodes) Bus-Based Interconnection Networks (10's Nodes) ENGRG 1060 Intro to ECE Christopher Batten 20 / 42

24 ECE Overview What is Computer Engineering? Trends in Computer Engineering Computer Engineering Design Exponential Scaling for rocessor Compute/Dollar Adapted from [Kurzweil 09] ENGRG 1060 Intro to ECE Christopher Batten 21 / 42

25 ECE Overview What is Computer Engineering? Trends in Computer Engineering Computer Engineering Design Exponential Scaling of emory Capacity/Dollar Adapted from [Kurzweil 09] ENGRG 1060 Intro to ECE Christopher Batten 22 / 42

26 ECE Overview What is Computer Engineering? Trends in Computer Engineering Computer Engineering Design Key trends in the application requirements and technology constraints over the past decade have resulted in a radical rethinking of the processors, memories, and networks used in modern computing systems Three Key Trends in Computer Engineering 1. Growing diversity in application requirements motivate growing diversity in computing systems 2. Energy and power constraints motivate transition to multiple processors integrated onto a single chip 3. Technology scaling challenges motivate new emerging processor, memory, and network device technologies ENGRG 1060 Intro to ECE Christopher Batten 23 / 42

27 ECE Overview What is Computer Engineering? Trends in Computer Engineering Computer Engineering Design Trend 1: Bell s Law Roughly every decade a new, lower priced computer class forms based on a new programming platform resulting in new usage and industries 10 8 rice in Dollars Supercomputers ainframes inicomputers Workstations ersonal Computers Scalable Clusters Handhelds Sensor Networks Internet of Things ENGRG 1060 Intro to ECE Christopher Batten 24 / 42

28 ECE Overview What is Computer Engineering? Trends in Computer Engineering Computer Engineering Design Trend 1: Growing Diversity in Apps & Systems ENGRG 1060 Intro to ECE Christopher Batten 25 / 42

29 ECE Overview What is Computer Engineering? Trends in Computer Engineering Computer Engineering Design Trend 2: Energy/ower Constrain All odern Systems ower = ower Energy Second Chip ackaging Chip Cooling System Noise Case Temperature Data-Center Air Conditioning = Energy Op Energy Ops Second Battery Life Electricity Bill obile Device Weight Energy per Operation 100W Workstation ower Constraint 1W Handheld ower Constraint erformance (Ops/Second) ENGRG 1060 Intro to ECE Christopher Batten 26 / 42

30 ECE Overview What is Computer Engineering? Trends in Computer Engineering Computer Engineering Design Trend 2: ower Constrains Single-rocessor Scaling Transistors (Thousands) DEC Alpha IS R2K Intel entium 4 Sequential rocessor erformance Frequency (Hz) Typical ower (Watts) Data partially collected by. Horowitz, F. Labonte, O. Shacham, K. Olukotun, L. Hammond ENGRG 1060 Intro to ECE Christopher Batten 27 / 42

31 ECE Overview What is Computer Engineering? Trends in Computer Engineering Computer Engineering Design Trend 2: Transition to ulticore rocessors Intel entium 4 Single monolithic processor Cray XT3 Supercomputer 1024 single-core processors N N AD Quad-Core Opteron Four cores on the same die N N IB Blue Gene Q Supercomputer Thousands of 18-core processors ENGRG 1060 Intro to ECE Christopher Batten 28 / 42

32 ECE Overview What is Computer Engineering? Trends in Computer Engineering Computer Engineering Design Trend 2: Energy and erformance of ulticores Energy (Joules per Task) Out-of-Order Superscalar Superpipelined Superscalar w/ Deeper ipelines B C ulticore E FD D Increasing ower rocessor ower Constraint Simple Single roc A General-urpose anycores erformance (Tasks per Second) ENGRG 1060 Intro to ECE Christopher Batten 29 / 42

33 ECE Overview What is Computer Engineering? Trends in Computer Engineering Computer Engineering Design Trend 2: ulticore erformance Scaling DEC Alpha IS R2K Intel entium 4 AD 4-Core Opteron Intel 48-Core rototype Transistors (Thousands) arallel roc erformance Sequential rocessor erformance Frequency (Hz) Typical ower (Watts) Number of Cores Data partially collected by. Horowitz, F. Labonte, O. Shacham, K. Olukotun, L. Hammond ENGRG 1060 Intro to ECE Christopher Batten 30 / 42

34 ECE Overview What is Computer Engineering? Trends in Computer Engineering Computer Engineering Design Trend 3: Emerging Device Technologies? Vertical OSFETs Graphene Carbon Nanotubes Nanorelays Quantum Computing olecular Computing emristers hase-change em Spintronics 3D Integration Nanophotonics Adapted from [Kurzweil 09] ENGRG 1060 Intro to ECE Christopher Batten 31 / 42

35 ECE Overview What is Computer Engineering? Trends in Computer Engineering Computer Engineering Design Key trends in the application requirements and technology constraints over the past decade have resulted in a radical rethinking of the processors, memories, and networks used in modern computing systems Three Key Trends in Computer Engineering 1. Growing diversity in application requirements motivate growing diversity in computing systems 2. Energy and power constraints motivate transition to multiple processors integrated onto a single chip 3. Technology scaling challenges motivate new emerging processor, memory, and network device technologies ENGRG 1060 Intro to ECE Christopher Batten 32 / 42

36 ECE Overview What is Computer Engineering? Trends in Computer Engineering Computer Engineering Design Activity #2: Sorting with a arallel rocessor Application: Sort 32 numbers Simulated arallel Computing System rocessor: Group of 2 8 students emory: Worksheet, scratch paper Network: Communicating between students Activity Steps 1. Discuss strategy with group 2. When instructor starts timer, master processor flips over worksheet 3. Sort 32 numbers as fast as possible 4. Lookup when completed and write time on worksheet 5. aster processor only raises hand 6. When everyone is finished, then analyze data N ENGRG 1060 Intro to ECE Christopher Batten 33 / 42

37 ECE Overview What is Computer Engineering? Trends in Computer Engineering Computer Engineering Design Activity #2: Discussion unsorted Network Distribute roc/em Sort 4 Numbers Network roc/em erge hase 1 > merge 4+4 = 8 Network roc/em Network roc/em Network sorted Algorithm Communication Load Balancing Fault Tolerance Dataset Size erge hase 2 > merge 8+8 = 16 erge hase 3 > merge = 32 ENGRG 1060 Intro to ECE Christopher Batten 34 / 42

38 ECE Overview What is Computer Engineering? Trends in Computer Engineering Computer Engineering Design Talk Outline ECE Overview What is Computer Engineering? Trends in Computer Engineering Computer Engineering Design ENGRG 1060 Intro to ECE Christopher Batten 35 / 42

39 ECE Overview What is Computer Engineering? Trends in Computer Engineering Computer Engineering Design What do computer engineers actually do? General Science Discover truths about nature Ask question about nature Construct hypothesis Test with experiment Analyze results and draw conclusions Computer Engineering Explore design space for a given system Design and build initial system Ask question about system odify system or build/design alternative Test with experiment to compare alternatives Analyze results and draw conclusions ENGRG 1060 Intro to ECE Christopher Batten 36 / 42

40 ECE Overview What is Computer Engineering? Trends in Computer Engineering Computer Engineering Design How do we design something so incredibly complex? Computer Engineering Explore design space for a given system Design and build initial system Ask question about system odify system or build/design alternative Test with experiment to compare alternatives Fighter Airplane: ~100,000 parts Intel Sandy Bridge E: 2.27 Billion transistors Analyze results and draw conclusions ENGRG 1060 Intro to ECE Christopher Batten 37 / 42

41 ECE Overview What is Computer Engineering? Trends in Computer Engineering Computer Engineering Design Design rinciples Abstraction Hide low-level details to create higher-level models Hierarchy Structurally decompose design; e.g., net router queues Regularity Structural and physical regularity; e.g., uniform tiles odularity Well-defined interfaces; e.g., latency insensitive net interface Encapsulation Hide implementation details; e.g., processor microarch Extensibility Design for future extensions; e.g., new network topo Design ethodologies Incremental design Test-driven design N ENGRG 1060 Intro to ECE Christopher Batten 38 / 42

42 ECE Overview What is Computer Engineering? Trends in Computer Engineering Computer Engineering Design Incremental Design + Network Network Network Network ENGRG 1060 Intro to ECE Christopher Batten 39 / 42

43 ECE Overview What is Computer Engineering? Trends in Computer Engineering Computer Engineering Design Test-Driven Design Test Types Unit tests Directed vs. random tests Whitebox vs. blackbox tests Integration tests Goal is to write tests first then implement design to pass these tests N Write tests for higher level of abstraction, refine implementation until passes tests, add new tests Capture design bugs with new tests ENGRG 1060 Intro to ECE Christopher Batten 40 / 42

44 ECE Overview What is Computer Engineering? Trends in Computer Engineering Computer Engineering Design Single-Core to ulti-core Design Example Computer Engineering Explore design space for a given system Design and build initial system Ask question about system odify system or build/design alternative Test with experiment to compare alternatives Analyze results and draw conclusions N Our "experiments" during the previous activities illustrate the design process N ENGRG 1060 Intro to ECE Christopher Batten 41 / 42

45 ECE Overview What is Computer Engineering? Trends in Computer Engineering Computer Engineering Design Take-Away oints ECE is a broad field focused on the study and application of electricity, microelectronics, and electro-magnetism Computer engineering is the process of designing abstraction and implementation layers to meet application requirements within physical technology constraints We are entering an exciting new era of computer engineering with emerging applications and systems, a remarkable shift towards mainstream parallel processing, and significant technology challenges ENGRG 1060 Intro to ECE Christopher Batten 42 / 42