CSC 2231: Parallel Computer Architecture and ... - cs.toronto.edu

CSC 2231: Parallel Computer Architecture and ... - cs.toronto.edu

CSC 2231: Parallel Computer Architecture and Programming GPUs Prof. Gennady Pekhimenko University of Toronto Fall 2017 The content of this lecture is adapted from the slides of Tor Aamodt (UBC) Project Progress Report Due next week Friday (Nov. 3rd) Ask questions after the class 2 Review #7 GPUs and the Future of Parallel Computin

g Steve Keckler et al., IEEE Micro 2011 Due Nov. 10 3 Review #5 Results Grades (out of 10) Mean: 9.05 10 9 8 7 6 5 4 3

2 1 0 6s 7s 8s 9s 10s 4 What is a GPU?

GPU = Graphics Processing Unit Accelerator for raster based graphics (OpenGL, DirectX) Highly programmable (Turing complete) Commodity hardware 100s of ALUs; 10s of 1000s of concurrent threads NVIDIA Volta: V100 5 +

The GPU is Ubiquitous [APU13 keynote] 6 Early GPU History 1981: 1996: 1999: 2001: 2002: 2005: 2006: IBM PC Monochrome Display Adapter (2D) 3D graphics (e.g., 3dfx Voodoo)

register combiner (NVIDIA GeForce 256) programmable shaders (NVIDIA GeForce 3) floating-point (ATI Radeon 9700) unified shaders (ATI R520 in Xbox 360) compute (NVIDIA GeForce 8800) 7 + process commands Host / Front End / Vertex Fetch transform vertices to screen-space

Vertex Processing generate pertriangle equations Primitive Assembly, Setup generate pixels, delete pixels that cannot be seen Rasterize & Zcull Pixel Shader determine the colors , transparencies and depth of the pixel Texture

do final hidden surface test,blend and write out color and new depth Pixel Engines (ROP) [David Kirk / Wen-mei Hwu] Frame Buffer Controller GPU: The Life of a Triangle 8 + pixel color result of running shader program

9 Why use a GPU for computing? GPU uses larger fraction of silicon for computation than CPU. At peak performance GPU uses order of magnitude less energy per operation than CPU. Rewrite Application CPU 2nJ/op GPU 200pJ/op Order of Magnitude More Energy Efficient However.

Application must perform well 10 + GPU uses larger fraction of silicon for computation than CPU? Control ALU ALU ALU

ALU Cache DRAM DRAM CPU [NVIDIA] GPU 11 CSC 2231: Parallel Computer

Architecture and Programming GPUs Prof. Gennady Pekhimenko University of Toronto Fall 2017 The content of this lecture is adapted from the slides of Tor Aamodt (UBC)

Recently Viewed Presentations

  • Broadband-Hamnet formerly HSMM-Mesh - summitares.org

    Broadband-Hamnet formerly HSMM-Mesh - summitares.org

    Broadband Hamnet - What is it? Broadband-Hamnetâ„¢ is a high speed, self discovering, fault tolerant, self configuring ham network/wireless computer network that can run for days from a fully charged car battery, or indefinitely with the addition of a modest...
  • Pass the planet!! What is this? 1  2

    Pass the planet!! What is this? 1 2

    This organelle assembles amino acids to create proteins. This is a small dense structure inside the nucleus that makes ribosomes. Organisms that have are only one cell are called _____ 9. This is organelle takes sunlight and uses it to...
  • AP European History Ch22 Lecture Terms Early Struggle vs ...

    AP European History Ch22 Lecture Terms Early Struggle vs ...

    The 1840s in Europe are also known as the "hungry forties" or the "starving forties" because of the frequent famines. A major drop in demand for goods resulted in high unemployment, especially in the textile industries. This atmosphere was ideal...
  • Chemical Equilibrium

    Chemical Equilibrium

    C = q / mol x T Just like specific heat, except you are using moles instead of mass Molar Enthalpy The change in energy per mole is referred to as Molar Enthalpy q/mol= H So, let's change the molar...
  • Ethics and Ethical Theories - SEIDENBERG SCHOOL OF CSIS

    Ethics and Ethical Theories - SEIDENBERG SCHOOL OF CSIS

    Ethics and Ethical Theories Herman T. Tavani, Ethics and Technology, Chapter 2, Wiley, 2004. Morality and moral systems Rules of conduct Rules for individuals Rules for social policies Principles of evaluation Justifying rules for moral systems Religion - teachings of...
  • ASF in Eastern Europe: achievements and perspectives

    ASF in Eastern Europe: achievements and perspectives

    ASF in Eastern Europe: achievements and perspectives. Ministerial Meeting, Tallinn, 26/02/16. Dr. B. Van-Goethem, Director . Crisis Management in Food, Animals and Plants. DG SANTE. ASF in the EU. Eradicated from. France (1974) Mainland Italy (1993) Belgium (1985) Netherlands (1986)...
  • Get it done from anywhere - DET Home

    Get it done from anywhere - DET Home

    Get it done quickly with Office Online. When you're using a computer that doesn't have the full desktop version of Office installed, Office Online is your Office in the cloud. View your documents, and even PDFs, in your browser or...
  • Chest Compression Only CPR Layperson Presentation

    Chest Compression Only CPR Layperson Presentation

    Chest Compression Only CPR. ... If the AED tells you to breathe for the person but you are trained in CCO, it is okay to just keep doing chest compressions. The unit will reanalyze the person's heart rhythm after 2...