The Truth About Beauty in Physics

The great physicist Hermann Weyl once said: "My work always tried to unite the true with the beautiful, but when I had to choose one or the other, I usually chose the beautiful." But is this actually good advice for doing physics?