The Zhaertaishan Group in the Alxa Block primarily consists of clastic rocks-carbonate deposits. The sediments were sourced from the underlying metamorphic basement, the North China Craton, and/or the Dunhuang Block. The unclear provenance hinders the understanding of Neoproterozoic tectonic events in the Alxa Block. Additionally, the study area lacks evidence of multiple Late Paleozoic tectonic events in its rock records. We utilize electron microprobe analysis and U-Pb dating on detrital heavy minerals from the Zhaertaishan Group in the Alxa Block to further constrain the provenance characteristics. Further, we analyze Neoproterozoic and Paleozoic tectonic events in the Alxa Block. Electron microprobe results of garnet show that the provenance of the Shujigou Formation is mainly from intermediate-acid rocks/metasedimentary rocks of amphibolite facies and granulite facies, while the provenance of the Zenglongchang Formation is mainly from intermediate-acid rocks/metasedimentary rocks of amphibolite facies. Electron microprobe results of detrital tourmaline indicate that tourmalines in the Zenglongchang Formation of the Zhaertaishan Group is mainly composed of schorl, with provenance derived from granitoids. The tourmaline in the Agulugou Formation is primarily dravite, with provenance derived from metasedimentary rocks. Combined with previous detrital zircon U-Pb dating results, the provenance of the Shujigou Formation is derived from intermediate-acid rocks/metasedimentary rocks of amphibolite facies and granulite facies at ~2.5 Ga and ~1.95 Ga. The provenance of the Zenglongchang Formation is derived from intermediate-acid rocks/metasedimentary rocks of amphibolite facies at ~1.9 Ga and granitoids from 1800~970 Ma. The provenance of the Agulugou Formation is derived from metasedimentary rocks from 1800~1000 Ma. The provenance results of the Zhaertaishan Group, along with field geological characteristics, reflect that the parallel unconformity between the Zenglongchang Formation and the Agulugou Formation represents the manifestation of the Rodinia supercontinent breakup. Electron microprobe and U-Pb dating results of detrital monazite indicate that monazite formed under metamorphic conditions, and the Alxa Block developed at least two phases of tectonic events during the Late Paleozoic, related to the subduction and orogeny of the Paleo-Asian Ocean.