It's a thought experiment illustrating how you could have a lack of relativity (e.g. because a fixed ether provides a universal reference frame) regardless of whether the universe was finite. A thought experiment is sufficient to disprove your claim linking infinity and relativity.
I don't actually mean that there's ether, as per the Michelson-Morely experiment.