Ibs

I have suffered from serious ibs since I was 16 doctors have told me to stay away from meat/gluten/dairy/wheat
But that doesn't leave me much to eat i can go to toilet 6 times between the time i get up 7am and 12 before I leave house . Im scared to eat when I go out because the amount of times I need the toilet so I have to plan days carefully and use tablets from shop to stop me needing a 💩 im in pain all the time when I eat a large dinner I have to stop half way through it go to toilet. Does anyone else have this problem