There is also a blur tool. It's grouped with the smudge tool.
Use a soft brush in overlay mode at low opacity to paint over an edge an edge.
In a new layer, paint over the edge to blur. Click on the layer to make a selection of the brush stroke. Change the work layer to the mask and use one of the blur tools.
Lower the contrast of the edge. Make a selection of the edge with the lasso tool and use a contrast or curves adjustment layer.
There is also a great mask tutorial by Deke McClelland "Photoshop: Masks and Channels" on Lynda.com.
Nov 18, 2020 at 09:31 AM
Previous versions of newhaven's message #15408035 « Softening a hard edge of a mask in PS »