The primary function of a cache in computer architecture is to store frequently accessed data temporarily, improving overall system performance. By reducing the time it takes to retrieve data from the main memory, a cache enables quicker access to information that the CPU often uses. This mechanism reduces latency and enhances processing speed, allowing for more efficient execution of applications and tasks in computing environments.