Not at all.
Your best success will be on hogs of 150 lbs. and under (with good shot placement), but larger hogs can be taken as well (just expect them to run some distance). If possible... take a neck shot or shoot directly through the middle of the shoulder (not behind it).
My Daughter's first Hog was taken with a .45 acp at a distance of 12 yds. from an 8' tripod stand... when She was 14 years old. Neck shot, dropped the 140 lb. Sow in it's tracks, then a quick 'follow up' shot for insurance to the heart/lung area.
I have shot quite a few Hogs with the .45 acp (none over 25 yds.) and have only failed to recover one.
The .40 S&W has similar muzzle energy when the most popular (standard) loads are used in each....so I see no problem with it.
Spartans ask not...how many, but where!