I avoid foods when certainly allergies kick in. I am not a seafood person and am pretty sure that I failed the crustachion test with my allergist as a kid. No shellfish.
Now I gave up a certain style of food, years ago, but in a different format, it is OK. This has to do with memories and who I used to have the food with, rather then something that others get. I gave up sheet cake (cupcakes OK to show form difference), and a relative gave up smoking.
I gave up alcohol at 25, after choking down one Bud light on about three hours, when celebrating a friend getting his dream job with KMOX after all the bad news/shit that he had just gone through (lost wife to cancer). I never liked beer, and my drink of choice was mixed with grain alcohol. Enough friends either had DUI's or died by the time I was 20, I was becoming the guy to stay sober and be the designated driver.