There are bottles out there that can be around $1. Of course, quantity helps drive down the price. Many companies have a large selection of stock bottles to choose from.
Other ways to drive down cost are looking at height of bottle and weight. The shorter height allows for more cases per pallet and a lighter weight bottle helps lower shipping costs.