PyCryptoScraper is an script to scrape detailed crypto-currency informations from the page CoinGecko.
This version was forked from patrick0585/PyCryptoScraper on 2018-05-01. We fixed a couple of issues with parsing of CoinGecko results. We might add some other features later on.
-
apt-get -y install python-lxml
marshmallow is an ORM/ODM/framework-agnostic library for converting complex datatypes, such as objects, to and from native Python datatypes.
marshmallow can be installed with pip:
pip install -U marshmallow --pre
To run PyCryptScraper you need to instantiate the class CryptoScraper.
cryptoscraper = CryptoScraper(currencies_to_scrape=[dict(name='bitcoin', tags=['usd', 'eur'])])
or you can execute the python script Scraper.py with certain parameters
python Scraper.py -c "[{'name':'bitcoin','tags':['usd','eur']}]"
or you can list all currencies from CoinGecko by running Scraper.py with no parameters. As of 2018-05-02 this was 1735 currencies and takes about 20 minutes to complete.
python Scraper.py
Test can be executed by the following command-line command:
python -m unittest discover -v
- Patrick Kowalik - Initial work - Crypto-Scraper
- Glenn Wood - Debugging and usability improvements - PyCrypto-Scraper