I am crawling https://kick.com/browse/categories where every time you scroll it loads new cards of a category. I have tried multiple methods using playwright but none of them worked.

I’m trying to crawl https://kick.com/browse/categories with playwright which has infinite scroll. I’ve tried evaluating the below js code and wait for an extended period for loading. I’m turning off headless for easier visual. In the browser the webpage can be scrolled for a few times. When it reaches the end, and the website requests to load more content, the request fails with 403. It says that javascript or cookie is not enabled.

I’m trying to crawl https://kick.com/browse/categories with playwright which has infinite scroll. I’ve tried evaluating the below js code and wait for an extended period for loading. I’m turning off headless for easier visual. In the browser the webpage can be scrolled for a few times. When it reaches the end, and the website requests to load more content, the request fails with 403. It says that javascript or cookie is not enabled.

I’m trying to crawl https://kick.com/browse/categories with playwright which has infinite scroll. I’ve tried evaluating the below js code and wait for an extended period for loading. I’m turning off headless for easier visual. In the browser the webpage can be scrolled for a few times. When it reaches the end, and the website requests to load more content, the request fails with 403. It says that javascript or cookie is not enabled.

I’m trying to crawl https://kick.com/browse/categories with playwright which has infinite scroll. I’ve tried evaluating the below js code and wait for an extended period for loading. I’m turning off headless for easier visual. In the browser the webpage can be scrolled for a few times. When it reaches the end, and the website requests to load more content, the request fails with 403. It says that javascript or cookie is not enabled.

I’m trying to crawl https://kick.com/browse/categories with playwright which has infinite scroll. I’ve tried evaluating the below js code and wait for an extended period for loading. I’m turning off headless for easier visual. In the browser the webpage can be scrolled for a few times. When it reaches the end, and the website requests to load more content, the request fails with 403. It says that javascript or cookie is not enabled.

I’m trying to crawl https://kick.com/browse/categories with playwright which has infinite scroll. I’ve tried evaluating the below js code and wait for an extended period for loading. I’m turning off headless for easier visual. In the browser the webpage can be scrolled for a few times. When it reaches the end, and the website requests to load more content, the request fails with 403. It says that javascript or cookie is not enabled.

I’m trying to crawl https://kick.com/browse/categories with playwright which has infinite scroll. I’ve tried evaluating the below js code and wait for an extended period for loading. I’m turning off headless for easier visual. In the browser the webpage can be scrolled for a few times. When it reaches the end, and the website requests to load more content, the request fails with 403. It says that javascript or cookie is not enabled.