You can get an unlimited amount of arrows by doing the following trick:

  1. Find a Guard training.
  2. Pickpocket his current arrows out then place one arrow of choice.
  3. Collect the arrows shot.
  4. Profit!


It may be a good idea to get your arrow back if you plan on doing extremely unlawful activities, such as killing chickens or slapping them stupid kids.