I had both. The closer focus distance of the 105mm is nice when working in indoor environments, but is awfully close to 85mm and the 85's are faster and much sharper lenses wide open with much less CA. The 135mm, IMHO, is better from a differentiation standpoint to the 85mm.
They really are good lenses for dreamy portrait shooting, but not without some issues. The CA is the worst I've seen in a non legacy lens. The focus reliability is not as good as modern G lenses with their internal focus motors (kind of like the difference between the 85 F1.4D and G.) The focus point moves with the DC ring so changing the DC ring during a shooting session will cause front or back focus. It is better to set it, fine tune the focus, and then forget it. The sharpness and more so the contrast degrades as you move the DC ring off center. I've read that the DC ring is often not properly centered which means the true DC center position might be somewhere between 0 and -2 or +2 so getting the maximum sharpness out of this lens is difficult unless you can somehow lock the ring on the true center.
Having said all that I will reiterate it works well for portraits and the CA smearing actually creates a nice dreaminess.
For me the negatives outweighed the positives. I will either buy the even more expensive but optically excellent Zeiss APO (which is one of the sharpest lenses available, albeit manual focus), the new Samyang 135 F2 (which is optically much optically superior to the Nikon or Canon offerings but also manual focus) or maybe wait to see what Sigma or Tamron offer. In the meantime I'm getting by with the Sigma 85mm F1.4, Nikon 105 micro and Tamron 70-200 F2.8 (which breathes down to 140 or so at close focus distances...like the Nikon VR2.)