Looks like you have to do some weird things to make it work properly due to the carrier switching. It does seem that Signal on Android has a workaround for this: https://github.com/WhisperSystems/Signal-Android/issues/4131