Total polyphenol and total flavonoid assays were performed to characterize the relationships between the color of (PJ) seed coat and stem and the content of phytochemical compounds. The samples were divided into two groups based on their stem and seed coat color, with each group containing 23 samples. The stem color group was subdivided into green, light red, and red, whereas the seed coat color group was divided into light brown, brown, and dark brown. In the stem color group, the light red stems exhibited the highest content of phytochemical compounds, with levels over 10% higher than those of the stems of the other colors. Moreover, among the top ten samples with the highest total polyphenol content, eight samples were light red, and the light red group also exhibited the highest total flavonoid content among the examined color groups. In terms of the seed coat color, the plants grown from dark brown seeds exhibited the highest contents of both total polyphenols and total flavonoids. In conclusion, PJ plants with dark brown seeds and light red stems contained the highest levels of phytochemical compounds. Collectively, our findings provide a valuable basis for future seed selection of PJ for pharmaceutical purposes.