I found a Microsoft documentation page that explains how to create a self-signed certificate with PowerShell, and it fits my needs in that setup just right. You can find the guide here.