How to block specific requests in scrapy-playwright based on URL patterns?
I’m using scrapy-playwright and I want to block certain requests based on URL patterns. Specifically, I need to:
1. Block requests that contain ‘img’ in the URL
2. Block requests that contain ‘Analytics’ in the URL.
Scrapy Playwright only renders part of a website
I’ve been attempting to scrape data from a website using Scrapy 2.11.2 along with its Scrapy/Playwright plugin (0.0.34). This is the website that I’m trying to scrape: here.