The function of a cache in a computer system is to temporarily store frequently accessed data to improve performance. By reducing access time for data retrieval, caching significantly speeds up the operation of applications and reduces workload on the primary storage.