You can limit the area of the result image that is blurred using the matte controls.

Use MatteLimits the area where you want to apply the blur on the result image, based on the output matte. Disable to blur the entire image.

Invert MatteInverts the matte selection, limiting the blur to areas outside the output matte.