These grow in a lot of public places. The trees are small and shrubby and look like they would make a good hedge if trimmed. The fruit is a bit sour at first, but definitely grows on you.

Brazil cherry, also known as surinam cherry and cayenne cherry.

http://en.wikipedia.org/wiki/Surinam_Cherry