PayPal: Experience Context causes “Create order” API call to fail

I want to set the shipping preference during a “Create order ” POST /v2/checkout/orders call.

Get complete shipping address from PayPal while showing PayPal popup

I know two ways of getting the shipping address, both of which are not sufficient in my case: