Resize the moment matrices after the first pass