How long ago did you put it up? 70' across? How many hog panels do you have and is it a square or round pen design?
A lot of it depends on deer density and available food and the time of year.
There are a lot of things that you can do to entice them in, like stxranchman said leave a panel open or you can put those sweet corn blocks in there, set your feeder to go off right before they move I have mine going off at 6:00 am and will move it up to 5:45 am tomorrow, in the pm at 8:30. If you throw to late in the am after they have bedded down (especially in the hot weather) the birds and squirrels get it, same thing in the afternoon.