front end wobble during decel with hands off the bars is pretty normal behavior for ANY motorcycle. If the rider keeps hands on bars, there is no wobble. On previous bikes I've owned, I've spent considerable time trying to iron out the wobble, because I often like to sit up in the saddle during a decel to a stop, and do NOT appreciate having the bike go into a wobble. My "fix" always has been to put a hair more torque onto the steering stem bearings, than called for in the spec. On my 2007 Venture, the spec torque is so low that I seriously doubt it is a correct spec. To end the Venture wobble I had to increase torque around 100% (can't recall the exact torque numbers just now). My 2014 FJR doesn't seem to have much of this problem, yet, so I have gone through the new-bike re-torque and scrupulously used the spec torque.
I don't think there is any danger of damaging bearings by adding a bit more torque. Even with double the torque on my Venture, the bearings never had a problem in the years I owned the bike. If you go a bit too far with the torque, however, the steering will be too tight to permit the front end to follow the road, and the bike will be hard to control.
I remember my 1971 BMW R60/5 had a large hand-operated nut on the steering stem, so the rider could adjust the steering tightness on the fly. Once, I snugged it down a bit too far while doing 70 mph and almost crashed, the bike didn't want to respond to my steering inputs at all. After that, I treated that big nut with a lot of respect!