Please update your location to say at least what county you live in like it said when you signed up. These questions have answers that vary from county to county. Nobody can give you a good answer unless they know who is handling your permit amendments.
When was your permit issued? Was it signed by Judge Kupferman or Seabert(spelling)? I met with Judge Kupferman back in February and he told me he was issueing sportman restrictions (hunting, target, camping, and hiking). I would write him and just simply ask he expand your permit to sportman restrictions. I'm actually willing to bet you get a letter back stating your current restrictions encompass the others activities that you are asking for. Here is the court address:
Hon. Richard A. Kupferman
30 McMaster St, Bldg #3
Ballston Spa, NY 12020