Relative Content

Tag Archive for pythonselenium-webdriverweb-scrapingbeautifulsoup

Unable to access link to scrap data using Selenium

I am newbie in using Selenium. Recently, I am trying to scrap data from JODI data source. This link is workable in browser but when I use Selenium or bs4 to access this link (in code) it shows error (unable to access). If not mistaken, this is a dynamic website

Unable to access link to scrap data using Selenium

I am newbie in using Selenium. Recently, I am trying to scrap data from JODI data source. This link is workable in browser but when I use Selenium or bs4 to access this link (in code) it shows error (unable to access). If not mistaken, this is a dynamic website

Unable to access link to scrap data using Selenium

I am newbie in using Selenium. Recently, I am trying to scrap data from JODI data source. This link is workable in browser but when I use Selenium or bs4 to access this link (in code) it shows error (unable to access). If not mistaken, this is a dynamic website

selenium’s driver gets wrong page in python

I am trying to scrape certain odds for a football tournament. To this end I wrote a piece of code which first generates the exact link I want and then loads the corresponding page. The problem is, the page loaded is not the exact page but a ‘neighbor’ (see below). Here is the code:

Why is my Selenium script only scraping data for 7 matches on F O R E B E T?

I’m working on a web scraping project using Selenium to scrape football match data from a sports prediction website ( lets use EXAMPLE for F O R E B E T) . However, my script only retrieves data for 7 matches, even though there are more matches listed on the webpage. Here’s the relevant part of my code:

How to get image src of carousel posts when scraping Instagram with Selenium

I’m trying to scrape Instagram photos with Selenium. The script is working to get the first image of all types of posts (single, video, carousels) but when I try to get the src of any subsequent images of a carousel post, it always returns the first image’s src. There’s no errors, just not the desired output. The issue lies in the new_image_element variable, I provided more code for context. I’ve only used Selenium, is this where BeautifulSoup would be handy or is there a different solution? Any help or insights would be greatly appreciated!