Use the proper tools for selecting or deselecting control points.
Pick or unpick CVs, edit points, hulls, and so on
(Windows) or
(Mac) key and press the
arrow keys to pick surrounding CVs (or edit points) one at a time.
.