If you have an image that is larger than the padding size, it crops the image to that size. The real underlying issue is https://kornia.readthedocs.io/en/latest/augmentation.module.html#kornia.augmentation.PadTo. I think we can write our own augmentation? I think this can be marked good first issue unless @jveitchmichaelis thinks there is some complexity here.
Desired functionality
An augmentation that pads the image to a given size if it smaller than that size. If it is larger, do nothing.