-
Notifications
You must be signed in to change notification settings - Fork 79
Description
Hi all,
I don't really know github and python very well and its been ages since I scraped some results so wondering if anyone can help.
I updated all the python drivers {?} beforehand.
I tried to get some results from May 2025 and this is the response I got. Can anyone help / advise please? Thanks in advance.
C:\Users\xxxx\rpscrape\scripts>rpscrape.py -r gb -d 2025/05/01-2025/05/31 -t jumps
Scraping races
Traceback (most recent call last):
File "C:\Users\xxxx\AppData\Local\Programs\Python\Python313\Lib\site-packages\curl_cffi\requests\session.py", line 652, in request
c.perform()
~~~~~~~~~^^
File "C:\Users\xxxx\AppData\Local\Programs\Python\Python313\Lib\site-packages\curl_cffi\curl.py", line 422, in perform
self._check_error(ret, "perform")
~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^
File "C:\Users\xxxx\AppData\Local\Programs\Python\Python313\Lib\site-packages\curl_cffi\curl.py", line 199, in _check_error
raise error
curl_cffi.curl.CurlError: Failed to perform, curl: (28) Operation timed out after 39177377 milliseconds with 0 bytes received. See https://curl.se/libcurl/c/libcurl-errors.html first for more details.
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "C:\Users\xxxx\rpscrape\scripts\rpscrape.py", line 285, in
main()
~~~~^^
File "C:\Users\xxxx\rpscrape\scripts\rpscrape.py", line 281, in main
scrape_races(race_urls, paths, args.race_type, client, file_writer)
~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\xxxx\rpscrape\scripts\rpscrape.py", line 214, in scrape_races
else Race(client, url, doc, settings.fields)
~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\xxxx\rpscrape\scripts\utils\race.py", line 49, in init
_, response = client.get(self.url)
~~~~~~~~~~^^^^^^^^^^
File "C:\Users\xxxx\rpscrape\scripts\utils\network.py", line 59, in get
response = self.session.get(
url,
allow_redirects=allow_redirects,
timeout=self.timeout,
)
File "C:\Users\xxxx\AppData\Local\Programs\Python\Python313\Lib\site-packages\curl_cffi\requests\session.py", line 675, in get
return self.request(method="GET", url=url, **kwargs)
~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\xxxx\AppData\Local\Programs\Python\Python313\Lib\site-packages\curl_cffi\requests\session.py", line 659, in request
raise error(str(e), e.code, rsp) from e
curl_cffi.requests.exceptions.Timeout: Failed to perform, curl: (28) Operation timed out after 39177377 milliseconds with 0 bytes received. See https://curl.se/libcurl/c/libcurl-errors.html first for more details.
C:\Users\xxxx\rpscrape\scripts>