Feature request: Please use the MediaWiki API available on Fandom wikia, for example, use this api url for elder scrolls: https://elderscrolls.fandom.com/api.php
The API documentation is available here and I think it'd be easier to get structured and clean data from the pages this way instead of the current method. The wikitext can be fetched directly. It would also make it faster to collect from the pages.
Current method: Preprocessing the html, cleaning and converting to markdown.
Feature request: Please use the MediaWiki API available on Fandom wikia, for example, use this api url for elder scrolls: https://elderscrolls.fandom.com/api.php
The API documentation is available here and I think it'd be easier to get structured and clean data from the pages this way instead of the current method. The wikitext can be fetched directly. It would also make it faster to collect from the pages.
Current method: Preprocessing the html, cleaning and converting to markdown.