If in other sciences we should arrive at certainty without doubt and truth without error, it behooves us to place the foundations of knowledge in mat… - William Rowan Hamilton

There is no mathematical substitute for philosophy.

Mathematics have a triple aim. They must furnish an instrument for the study of nature. But that is not all: they have a philosophic aim and, I dare maintain, an esthetic aim. They must aid the philosopher to fathom the notions of number, of space, of time. And above all, their adepts find therein delights analogous to those given by painting and music. They admire the delicate harmony of numbers and forms; they marvel when a new discovery opens to them an unexpected perspective; and has not the joy they thus feel the esthetic character, even though the senses take no part therein? Only a privileged few are called to enjoy it fully, it is true, but is not this the case for all the noblest arts?
This is why I do not hesitate to say that mathematics deserve to be cultivated for their own sake, and the theories inapplicable to physics as well as the others. Even if the physical aim and the esthetic aim were not united, we ought not to sacrifice either.

It seems to be one of the fundamental features of nature that fundamental physical laws are described in terms of a mathematical theory of great beauty and power, needing quite a high standard of mathematics for one to understand it. You may wonder: Why is nature constructed along these lines? One can only answer that our present knowledge seems to show that nature is so constructed. We simply have to accept it. One could perhaps describe the situation by saying that God is a mathematician of a very high order, and He used very advanced mathematics in constructing the universe. Our feeble attempts at mathematics enable us to understand a bit of the universe, and as we proceed to develop higher and higher mathematics we can hope to understand the universe better.