New programming language makes turning GPUs into supercomputers a snap. CPUs and GPUs are both important for modern computing, with each being better suited for different tasks. Most CPUs have several cores capable of running a few processing threads. It runs each thread very fast, then moves on to the next one. A GPU typically has a large number of slower processing cores (sometimes called stream processors) which can run more simultaneous threads. We would say that GPU computing is inherently more parallel than the CPU variety.

http://www.extremetech.com/computing/160367-new-programming-language-makes-turning-gpus-into-supercomputers-a-snap