Thanks to the internet I was able to identify a volunteer tree in my yard. Thanks must also go to whichever bird planted it for me. :)
Naturally the birds have taken most of the fruit, but I'm happy to have a mulberry tree. Aren't the leaves strange? I wonder why they take different shapes on the same tree.