Probably not. You want two things in a driveway base: mechanical stability under wet and dry conditions, and good drainage so water doesn't collect, especially if you're subject to freezing conditions. The base also depends on the kinds of loads, but this usually includes some large trucks from time to time (moving vans, oil trucks, etc.) Therefore one usually wants to bring in crushed gravel or good bank gravel, topping it with especially good material like crushed stone. If you happen to live on top of a very good gravel bed,you could probably get by without bringing in material, but you also don't want any large rocke becasue freeze thaw cycles will bring them up through the surface over time.