From I-40 take Exit 64, and go South on NC Hwy 9. In 9.9 miles turn left onto Old Fort Road. In 3.2 miles turn right onto Camp Elliott Road (at the sign for Stone Mountain School). The lot is on the left in 1/2 mile.
Mapquest doesn't have the location quite right on Camp Elliott road.