Unless you buy everything from local producers who get all their components from local producers, you are indeed affected by oil prices, regardless if you own a car or not.
There are degrees of affectedness, though. I live 2 miles from work, bike in during spring/summer/fall, and my employer provides food on weekdays (technically on weekends as well, if I wanted to go into work then). I tank up on gas about once every 6 weeks, it costs me about $30, and I spend maybe $25-30/week on food. It's well within my budget, and would continue to remain so even if gas went to $10/gallon.
That's a far cry from someone who commutes 20 miles to work in an SUV and spends $60/week just on gas. These people are hurting now. If you have the opportunity to re-arrange your lifestyle so that it's a bit less sensitive to oil prices, it may be a good idea to do so.
I wasn't suggesting otherwise, merely that I am oblivious to what the current price of a gallon of gas is and have been for some time. Since giving up my car, I have been in a gas station twice. I pay zero conscious attention to such things and rarely have the opportunity to just happen to notice it. So, in this longer view, I attribute the general rise in gas prices mostly to peak oil -- which in no way negates the fact that in the shorter run there are many factors which influence the price of any given commodity.
Furthermore, I imagine that even if I did get everything locally grown/made, the price of gas would still have an impact -- unless the farmers were all Amish or something and didn't use gasoline-powered farm equipment.