We have been trying to setup a prometheus on k8s using the prometheus community helm chart. From what I understand to enable basic auth for the prometheus dashboard it is only really possible to setup the basic auth on the ingress. We struggled to setup the ingress independently of this helm, only when we enable ingress on the values.yaml and fed that to helm, did the ingress work (so the chart did the setup). So we can access the prometheus dashboard no issue. But when following the config for the basic auth using the nginx ingress nothing happens, we added the annotations to the prometheus values.yaml and upgraded the install. Viewing the ingress after the update shows the annotations where added but basic auth is still disabled. If we view the nginx ingress controller pod logs we see the request come in but no attempt to prompt for auth, its not even trying.