Sure, simply make the video "private".  (Video Manager --> Edit --> Privacy Settings.

 

Upon making it private, YouTube will display a box where you may enter the YT username or email address of those you wish to share it with.

 

Unless YT has changed this, there is a limit of 50 users you may share with.