Yes, it should be fine. But you have to bear in mind that those binaries are built against a specific version of NumPy, and new releases of NumPy are made often.
The pre-built binaries should be absolutely fine for nearly everything you want to do though!
Out of interest, what are you thinking of creating with NumPy?