I want to download all the comments of a hotel, which are paginated. For example, from this hotel:

I am trying to download data with imf.data package. Below you can see my code with example of single country.

I am running a map_dfr on a set of webpages to pull various elements that will be bundled into a data frame. I made a simple example to show the issue with just two pages to loop through. In the first page of the two, there is a “defense” table but there isn’t one in the second page of the loop. (There is an offense table for both – FYI)

I have a working data / web scrape function in R using HTTR and POST to scrape public data on a number of police statistics, but the code only seems to work sporadically. I suspect this is the result of cookies, but so far my attempts to add any code that would preserve or reset cookies hasn’t fixed things. The following code has worked repeatedly to collect information on one instance, but then fails to collect the same data subsequently (this would eventually iterate on the unique identifier within “payload” after “values,” here with the example ID 940216):