Connection pools in serverless architecture are caches of pre-established, reusable database connections managed by the application or a middleware proxy. They minimize the high latency caused by opening/closing database connections on every request and prevent database overload by limiting total concurrent connections from highly scalable serverless functions.