It's best to think of this terminology relative to the host processor.
For cameras or sensors, the deserializer is connected to the processor so it is "local" and the serializer connected on the other end of the link is "remote".
For displays, the logic is opposite. The processor is connected to the serializer which is the "local" device and the deserializer is connected to the display on the other end of the link and is "remote".