Add functionality for non-standard sitemap.xml

[rwils83]

See TODO.md for example

[sandhyak-tech]

Could u plz assign this to me .. and elaborate on non-standard sitemap.xml ?

[rwils83]

@sandhyak-tech So, if you go to https://www.google.com/slides/sitemaps.xml, the way they do the sitemap is much different than for example, https://www.tiktok.com/tos/node/sitemaps/sitemap.xml. The problem with the difference is I am using the xml parser to look for the part of the standard sitemap.xml files. I think doing something like re to find patterns like www.example.com in the nonstandard style will fix the issue, but I haven't had time to write it. If any more clarification is needed, let me know

[sandhyak-tech]

@rwils83 .. Could u plz explain on what is standard and non-standard sitemap .. u mean the input format ?

[rwils83]

@sandhyak-tech yes. So standard sitemap looks like

`

  <loc>http://www.example.com/</loc>

  <lastmod>2005-01-01</lastmod>

  <changefreq>monthly</changefreq>

  <priority>0.8</priority>

`
which is what the current app knows how to parse. I need it to extend to sitemaps that follow unusual/non-standard sitemaps like google uses, which looks more like

https://www.google.com/slides/about/ Weekly 0.8 https://www.google.com/intl/af/slides/about/ Weekly 0.8 https://www.google.com/intl/id/slides/about/ Weekly 0.8 https://www.google.com/intl/ms/slides/about/ Weekly 0.8 https://www.google.com/intl/ca/slides/about/ Weekly 0.8 https://www.google.com/intl/cs/slides/about/ Weekly 0.8 https://www.google.com/intl/da/slides/about/ Weekly 0.8 https://www.google.com/intl/de/slides/about/ Weekly 0.8 https://www.google.com/intl/et/slides/about/ Weekly 0.8 https://www.google.com/intl/en-gb/slides/about/ Weekly 0.8 https://www.google.com/intl/es/slides/about/ Weekly 0.8 https://www.google.com/intl/es-419/slides/about/ Weekly 0.8 https://www.google.com/intl/eu/slides/about/ Weekly 0.8 https://www.google.com/intl/fil/slides/about/ Weekly 0.8 https://www.google.com/intl/fr/slides/about/ Weekly 0.8 https://www.google.com/intl/gl/slides/about/ Weekly 0.8 https://www.google.com/intl/hr/slides/about/ Weekly 0.8 https://www.google.com/intl/zu/slides/about/ Weekly 0.8 https://www.google.com/intl/is/slides/about/ Weekly 0.8 https://www.google.com/intl/it/slides/about/ Weekly 0.8 https://www.google.com/intl/hu/slides/about/ Weekly 0.8 https://www.google.com/intl/nl/slides/about/ Weekly 0.8 https://www.google.com/intl/no/slides/about/ Weekly 0.8 https://www.google.com/intl/pl/slides/about/ Weekly 0.8 https://www.google.com/intl/pt-br/slides/about/ Weekly 0.8 https://www.google.com/intl/pt-pt/slides/about/ Weekly 0.8 https://www.google.com/intl/ro/slides/about/ Weekly 0.8 https://www.google.com/intl/sk/slides/about/ Weekly 0.8 https://www.google.com/intl/sl/slides/about/ Weekly 0.8 https://www.google.com/intl/sv/slides/about/ Weekly 0.8 https://www.google.com/intl/vi/slides/about/ Weekly 0.8 https://www.google.com/intl/tr/slides/about/ Weekly 0.8 https://www.google.com/intl/el/slides/about/ Weekly 0.8 https://www.google.com/intl/bg/slides/about/ Weekly 0.8 https://www.google.com/intl/mn/slides/about/ Weekly 0.8 https://www.google.com/intl/ru/slides/about/ Weekly 0.8 https://www.google.com/intl/sr/slides/about/ Weekly 0.8 https://www.google.com/intl/uk/slides/about/ Weekly 0.8 https://www.google.com/intl/ka/slides/about/ Weekly 0.8 https://www.google.com/intl/hy/slides/about/ Weekly 0.8 https://www.google.com/intl/hu/slides/about/ Weekly 0.8 https://www.google.com/intl/iw/slides/about/ Weekly 0.8 https://www.google.com/intl/ur/slides/about/ Weekly 0.8 https://www.google.com/intl/ar/slides/about/ Weekly 0.8 https://www.google.com/intl/fa/slides/about/ Weekly 0.8 https://www.google.com/intl/am/slides/about/ Weekly 0.8 https://www.google.com/intl/ne/slides/about/ Weekly 0.8 https://www.google.com/intl/mr/slides/about/ Weekly 0.8 https://www.google.com/intl/hi/slides/about/ Weekly 0.8 https://www.google.com/intl/bn/slides/about/ Weekly 0.8 https://www.google.com/intl/gu/slides/about/ Weekly 0.8 https://www.google.com/intl/ta/slides/about/ Weekly 0.8 https://www.google.com/intl/te/slides/about/ Weekly 0.8 https://www.google.com/intl/kn/slides/about/ Weekly 0.8 https://www.google.com/intl/ml/slides/about/ Weekly 0.8 https://www.google.com/intl/si/slides/about/ Weekly 0.8 https://www.google.com/intl/th/slides/about/ Weekly 0.8 https://www.google.com/intl/lo/slides/about/ Weekly 0.8 https://www.google.com/intl/km/slides/about/ Weekly 0.8 https://www.google.com/intl/ko/slides/about/ Weekly 0.8 https://www.google.com/intl/zh-HK/slides/about/ Weekly 0.8 https://www.google.com/intl/zh-CN/slides/about/ Weekly 0.8 https://www.google.com/intl/zh-tw/slides/about/ Weekly 0.8 https://www.google.com/intl/ja/slides/about/ 

Currently, the app would error out because it is looking for standard xml sitemap tags

[rwils83]

@sandhyak-tech a reference to the standard is located at https://www.sitemaps.org/protocol.html. but tldr; yeah for the sitemap getting input to the app, some sitemaps don't follow the standard and I need to figure out how to future proof the app for those cases lol

[sandhyak-tech]

Got it @rwils83 .. Thank u .. Will fix this