I wanted to have a pony party but never got around to it.
The pony rides cost $250/ for the first hour and $175 for each additional hour. The pony ride will also include a miniature pony for the kids to pet and feed.
http://www.windswept.com/entertainers/entertainers.html
Not sure about the permits but they could tell you.