Answer:
Double-click the header in any one page to go to the editing mode, and then, select the content of the header, see screenshot. Then, press Delete key on keyboard, and then click Close Header and Footer to exit the editing mode, all headers in this current document have been deleted immediately.
