Whenever it is deemed expedient, it shall be lawful for the Central Government, the Chief of the Naval Staff or senior officer present, by an order in writing in the prescribed form, from time to time to change the place of confinement of any offender imprisoned or sentenced to be imprisoned or detained in pursuance of this Act or of any offender undergoing or sentenced to undergo detention; and the gaoler or other person having the custody of such offender shall immediately on the receipt of such order remove such offender to the gaol, prison or house of correction or, in the case of an offender undergoing or sentenced to undergo detention, to the naval detention quarters mentioned in the said order, or shall deliver him over to naval custody for the purpose of the offender being removed to such prison or naval detention quarters, and every gaoler or keeper of such last-mentioned prison, gaol, or house of correction or naval detention quarters shall, upon being furnished with such order of removal, receive into his custody and shall confine pursuant to such sentence or order every such offender.