i try to get this informaitons out of the listbox:

I’m trying to scrape metadata from a https://yellowpages.com.eg/en/category/abrasives using Selenium and BeautifulSoup. I can successfully extract some data, but I’m having trouble getting the text from a tag nested inside a div within a loop. Here’s my current code:

I’m following the documentation on the Selenium website for how to wait for Ajax responses before proceeding, and while the correct dynamically loaded information is found, a timeout error is still thrown.

I am trying to build a scrapper for the US Gucci website. I do manage to get the data for the products on the first page of the handbags category, however, after clicking on the load more button and scrolling to the bottom of the page I get the error: ‘NoneType’ object has no attribute ‘text’

New to web scraping and selenium/beautifulsoup in general. I’ve been trying to scrape data from this website but beautifulsoup can’t seem to find the text that I want. I just want the date of the first incident that shows up so I used inspect element to find the text is in a vaadin-grid-cell-content tag with slot=”vaadin-grid-cell-content-10″

I’m using BeautifulSoup and Selenium for web scraping reviews on Goodreads. I’m able to get the results I want, but I want to use Actions to click the “show more reviews” button so that the page keeps loading and I can repeat the code to get more reviews.

i do like more than 50x times to create python script, using bs4, beautifulsoup, request, re, selenium. to make script injecting custom tag element on live website, and make nothing change on live website.
if you guys really can make this tools for me, inject the custom tag element on my test website here .
feel free to contact me on telegram :
nb: sorry about my english

While scraping a website I encountered a strange behaviour, running the script multiple times gives variable results. Sometimes the number of elements obtained by find_all is the expected one, others instead I find duplicates, after using set() I obtain the same elements as before.

selenium.common.exceptions.ElementNotInteractableException: Message: Element could not be scrolled into view
Stacktrace:
RemoteError@chrome://remote/content/shared/RemoteError.sys.mjs:8:8
WebDriverError@chrome://remote/content/shared/webdriver/Errors.sys.mjs:193:5
ElementNotInteractableError@chrome://remote/content/shared/webdriver/Errors.sys.mjs:353:5
webdriverClickElement@chrome://remote/content/marionette/interaction.sys.mjs:166:11
interaction.clickElement@chrome://remote/content/marionette/interaction.sys.mjs:135:11
clickElement@chrome://remote/content/marionette/actors/MarionetteCommandsChild.sys.mjs:204:29
receiveMessage@chrome://remote/content/marionette/actors/MarionetteCommandsChild.sys.mjs:84:31

The app is web scraping. It will eventually be on a live website, hence headless mode being crucial. I was following a few guides and videos, such as this: https://www.youtube.com/watch?v=ne3BH9-5H2o