The problem, he adds, is that we seem to have trouble figuring out which brick walls are worth worrying about and which ones we should try to tear down.