Warps and SIMD performance impact of control divergence Parallel reduction Memory parallelism

Prefix Sum A Work-inefficient Scan Kernel A Work-Efficient Parallel Scan Kernel More on Parallel Scan

《超级计算》教学资源（参考资料）高性能计算环境支持讲座——MPI编程讲义（消息传递并行编程环境MPI）

机群应用开发（PPT讲稿）并行编程原理及程序设计 Parallel Programming：Fundamentals and Implementation

电子科技大学：《GPU并行编程 GPU Parallel Programming》课程教学资源（课件讲稿）Lecture 07 JOINT CUDA-MPI PROGRAMMING

• Study increasingly sophisticated parallel merge kernels • Observe the combined effects of data - dependent execution and a lack of data parallelism on GPU algorithm design

parallel histogram Data Racing condition privatized histogram kernel

Memory access efficiency Tiled Matrix Multiplication Tiled Matrix Multiplication Kernel Handling Boundary Conditions in Tiling Tiled Kernel for Arbitrary Matrix Dimensions

Multidimensional Kernel Configuration Color-to-Greyscale Image Processing Example Blur Image Processing Example

Introduction to Heterogeneous Parallel Computing CUDA C vs. CUDA Libs vs. OpenACC Memory Allocation and Data Movement API Functions Data Parallelism and Threads