Reports of falling bricks and buckling columns have prompted evacuations in the area around a Midtown Manhattan high-rise office building that was being converted to luxury apartments, fire officials said Tuesday.