I wanted to build a website that will have the links to mp3s on other websites. Does google permit us to put the adsense on such website?
Really depends what do you do with that (where the link goes).
In case you cant use Adsense, you could look into other adverts network where this is allowed.
It is no for Adsense. Any music/video downloads not allowed unless you're a very reputed company.