We collected samples (i.e., the aerial parts and roots of Juncus effusus and their growth media) in the indigenous zinc smelting area in the northwest region of Guizhou Province, China, and we measured and analyzed potentially toxic metal(loid)s (arsenic, As; cadmium, Cd; chromium, Cr; copper, Cu; mercury, Hg; lead, Pb and zinc, Zn) in these samples. The results include the following: First, there is a high concentration of one or more potentially toxic metal(loid)s in the slag and surrounding soil in the research area. This situation might be caused by metal(loid) damage or contamination due to the circumstances. Additionally, Juncus effusus in the indigenous zinc smelting area are contaminated by some potentially toxic metal(loid)s; since they are used for Chinese medical materials, it is especially significant that their As, Cd and Pb concentrations are greater than their limited standard values. Finally, both the bioconcentration factors and transfer factors for most potentially toxic metal(loid)s in Juncus effusus are less than 1 in the study area. Therefore, we suggest that Juncus effusus could be used for phytostabilization or as a pioneer plant for phytoremediation of potentially toxic metal(loid)s because it has a tolerance and exclusion mechanism for these metal(loid)s in the research district.