Heritage board fearful for fate of carriage house