Upon delivery of any order made under section 3 to the officer in charge of the prison in which the person named therein is confined, that officer shall cause him to be taken to the court in which his attendance is required, so as to be present in the court at the time of such order mentioned, and shall cause him to be detained in custody in or near the court until he has been examined or until the judge or presiding officer of the court authorises him to be taken back to the prison in which he was confined.