So, why bother with patching servers in the first place?

Mainly to make attacking the site more difficult, as there are new exploits against Internet facing sites constantly.

OpenSSH vulnerability regreSSHion puts millions of servers at risk
Researchers from Qualys say regreSSHion allows attackers to take over servers with 14 million potentially vulnerable OpenSSH instances identified.

This latest one is at least harder to exploit, but regular site and software patching just makes sense.