Amid a decline in new housing permits, price increases on materials could further weaken the building industry.