This current API being used to query Google, Bing, Yahoo, etc. is limited and needs to be replaced by a custom web crawler to collect links.