--ignore_fragments is not supported (but documented) #38
Description
$ bundle exec rawler --ignore_fragments http://google.com
Error: unknown argument '--ignore_fragments'.
Try --help for help.
$ bundle exec rawler --ignore_fragments http://google.com
Error: unknown argument '--ignore_fragments'.
Try --help for help.
--help doesn't print the option, despite it being documented on GitHub.
$ bundle exec rawler --help
Rawler is a command line utility for parsing links on a website
Usage:
rawler http://example.com [options]
where [options] are:
--username, -u <s>: HTTP Basic Username
--password, -p <s>: HTTP Basic Password
--wait, -w <f>: Seconds to wait between requests, may be fractional
e.g. '1.5' (default: 3.0)
--log, -l: Log results to file rawler_log.txt
--logfile, -o <s>: Specify logfile, implies --log (default:
rawler_log.txt)
--css, -c: Check CSS links
--skip, -s <s>: Skip URLs that match a pattern
--iskip, -i <s>: Skip URLs that match a case insensitive pattern
--include, -n <s>: Only include URLS that match a pattern
--iinclude, -d <s>: Only include URLS that match a case insensitive
pattern. Equivalent to '--include
^http://mysite.com/*'.
--local, -a: Restrict to the given URL and below
--version, -v: Print version and exit
--help, -h: Show this message