Speak up. Hey friend, I noticed you have this habit. While it has never offended me, it is inappropriate for the office environment. Myself and everyone else will appreciate it if you keep your hands to yourself. (Include HR if needed)
If he continues this behavior, eventually it will get him fired. Ie. If I did this at my age to someone your age. Totally creepy.