You cannot restrict access to invidual topics or category's, but you can restrict access to individual forums. If you restrict access to the individual forums, then all topics in that forum will be restricted to those who you grant access to.
Lock the forum in question, then grant access (after enabling private forums in the admin area) using a variety of methods. In your case, edit the forum and use the Allowed Members List.