The Xilin Group, composed of the Chenming, Laodaomiaogou, Qianshan and Wuxingzhen formations, is one of the Early Paleozoic terranes in the eastern Songliao Massif, mainly consisting of thick layers of fine clastic and carbonate rocks. This study presents LA-ICP-MS zircon U-Pb geochronological data for the Laodaomiaogou and Qianshan formations, further constraining their provenance and the Early Paleozoic tectonic evolution of the Songliao Massif on the eastern Central Asian Orogenic Belt. Most zircons from the Laodaomiaogou and Qianshan formations show magmatic oscillatory zoning and high Th/U ratios (0.26–2.41). Zircon U-Pb dating results indicate that the detrital zircons from the silty mudstone of the Laodaomiaogou Formation yield peak ages of 634 Ma, 775 Ma, 820 Ma, 880 Ma and 927 Ma, as well as multi-episodic Archean to Paleoproterozoic and Mesoproterozoic ages (1405–643 Ma), implying its deposition time is younger than ~634 Ma. Furthermore, the occurrence of Early Cambrian fossils indicates that the Laodaomiaogou Formation was deposited during the late stage of the Early Cambrian (~514 Ma). The zircons from the K-bentonite of the Qianshan Formation show four peak ages of 444 Ma, 471 Ma, 489 Ma and 518 Ma and the youngest age peak of 444 ± 4 Ma (n = 6) indicates that the Qianshan Formation was deposited during the Late Ordovician. In addition, the peak ages of the detrital zircons in the silty mudstone of the Qianshan Formation are 472 Ma and 498 Ma, as well as two other concordant points with 207Pb/206Pb apparent ages of 1824 Ma and 1985 Ma. The dating results in this study, together with published data, indicate the absence of Pan-African magmatic events in the Songliao Massif prior to the initial deposition of the Xilin Group, in contrast to those distributed widely in the Jiamusi Massif. Taken together, we conclude that the depositional provenance of the Laodaomiaogou and Qianshan formations was derived from the Songliao Massif. Furthermore, the characteristics of the detrital zircon age composition and rock associations indicate that the Laodaomiaogou Formation formed in a passive continental margin environment, in contrast to the Qianshan Formation, which formed in an active continental margin environment. The above results also imply that the Songliao and Jiamusi massifs might not have collided before the Late Ordovician.