In a saucepan, combine butter or margarine, evaporated milk, granulated sugar and vanilla extract. Bring to a boil over medium-high heat and continue to cook for 5 minutes. Pour over pancakes and fruit while syrup is still warm.