Convict labour built many of Perth's iconic colonial buildings between 1850 and 1868, including the Pensioner Barracks and Government House.