The primary purpose of a computer's GPU (Graphics Processing Unit) is to handle rendering of graphics and images. It accelerates the processing of visual data, allowing for smoother graphics in applications like video games and design software. By performing complex calculations in parallel, the GPU significantly enhances performance compared to the CPU (Central Processing Unit) when dealing with graphics-intensive tasks.