Actually he did no work at all! when picking up the box he did work against gravity. When setting it down gravity did the same work back to the mover. (Gravity is a conservative force so the path of the box is immaterial). While walking with the box the displacement is perpendicular to the force so the dot product is zero there.
