I am trying to make a semi-automatic app for downloading a pdf from a webpage, where data are set on a form automatically, then users have to solve a captcha and lastly a pdf should be downloaded, but I don’t know how to replicate the click on the download button, I guess there may be an easy solution without the need for running a selenium server, this is the code all the way to uploading the form, presenting the captcha and receiving the users input:

I am trying to make a semi-automatic app for downloading a pdf from a webpage, where data are set on a form automatically, then users have to solve a captcha and lastly a pdf should be downloaded, but I don’t know how to replicate the click on the download button, I guess there may be an easy solution without the need for running a selenium server, this is the code all the way to uploading the form, presenting the captcha and receiving the users input:

New to web scraping so forgive the basic question, but I’m trying to scrape film URLs from lists on Letterboxd and having some issues. Using this list as an example, I was able to find the link location in the HTML here:

I’m trying to scrape this page with the rvest R package: https://www.bienici.com/recherche/achat/dessin-669cc780ec9a6600b7687ce8/2-pieces?prix-max=260000&surface-min=40&surface-max=55&neuf=non&mode=liste&tri=publication-desc
But I can’t retrieve the elements by id, class or Xpath, the results is always {xml_nodeset (0)}. I don’t know why habitually it works well.

I want to scrape from a Uniprot webpage like this http://www.uniprot.org/uniprot/Q4DQV8 the strings that starts with “Tc00” (in this case “Tc00.1047053511911.60”) using R. I’ve tried the following but the function read_html() doesn’t retrieve me any data I can like that.

Good evening, guys!

I’m trying to download a parameterized .csv file from a page. I’m quite new to scraping but it seems to me that I need to fill out a form with desired values and then submit it to receive a response (the file itself).

I’m having trouble scraping data from https://ser-sid.org/, a database for seed traits. I’ve successfully retrieved a table of potential attributes of species along with their URLs using the following code:

I am trying to webscrape the Defence Table from the following page: https://www.pro-football-reference.com/boxscores/202402110kan.htm

I am trying to scrape data from https://www.kaggle.com/datasets/jacouchs/marketing-budget-and-actual-sales-dataset with using rvest and SelectorGadget.In the link there is a table with 222 rows and 2 columns. I need to assign each coloumns to different variables.