We had the exact same problem with the cabbage white caterpillars, and picked them off every evening and chucked them in the compost. They are ravenous blighters.
We don’t have a massive garden but we do okay. Here’s some toms, cucumbers n courgettes.
I pruned my olive tree, roses, and Citrus. Removed an overgrown Diosma and the Leptospermum it had overwhelmed. Pulled out my herb patch, dug some mushroom compost into the soil, and re-planted it. Planted two Grevillea Robyn Gordon to replace the things I took out of the front hedge…. This coming week I have to plant a new Leptospermum, move nine dwarf Grevilleas and plant nine prostrate Grevilleas. Then give everything its Spring feed, spray for fungus, and spread some mulch about. Then in a few weeks I have to prune the front hedge. Then plant a Callistemon that I have been coddling in a pot.
I probably won’t eat it, it feels like leather, but he’s huge! Also that’s not some hideous fungus on the heel of my hand, I’d been making pizza dough and missed some!
I have had a few stringy beans get through this year. Bit disappointing. Then I get a whole bunch of delicious ones. I use a proper bean slicer to get the edges peeled off well but I seem to find out difficult to judge which ones to pick and dump and those to pick and eat.
My neighbor who used to be a professional gardener at some point (two decades ago–time flies) has grown a cherry tree in a container (right now it’s in his garden though) and I believe citrus is also good in containers. I guess you could probably grow a peach tree in a container as well, those do very well even when they are very small.
Can you get a potted tree enough light, like with a greenhouse? (If so, I’m jealous!)
In my little town, there’s a house that has a fig tree in a container, presumably so it can move indoors through the winter. I’ve seen it fruiting in the past. Like @yashima mentioned, I think you’ve got some citrus options, too. For some reason calamansi comes to mind. Keep an eye out for dwarf varieties?
I also remember a farmer back when I lived in central Wisconsin (read: much colder than Yorkshire) who kept a lemon tree in his greenhouse. Once a year he’d bring a small basket of locally-grown lemons to the market in deep winter.
I talked to a friend who is much better at gardening than I am and he said apricots or plums could be good. He said peach trees are difficult unless you know what you do with pruning them (just repeating his words).
Over here some shops sell tree types that are designed to remain small and compact, they call this “column fruit trees” here. They grow straight and narrow usually.