The Museum of World Religions, Yonghe. This is a fantastic museum that will cost you NT$150 and take you about 2 hours. Located in YongHe, the museum is right next to the Sogo department store on ZhongShan Road.
Inside are great collections of items and information from major world religions: Christian, Jewish, Islam, Buddhist, Taoist, Shinto, Maya, Hindu, Sikh, Egyptian. There is also a fine presentation of Taiwan folk religion as well.
I strongly recommend it.
Google Earth link