Brown algae comprise up to 2000 species with wide dissemination in temperate zones. A comprehensive untargeted metabolic profiling guided by molecular networking of three uninvestigated Red-Sea-derived brown algae, namely , , and , led to the identification of over 115 metabolites categorized as glycerolipids, fatty acids, sterol lipids, sphingolipids, and phospholipids. The three algae exhibited low-to-moderate antioxidant capacity using DPPH and ABTS assays. Preliminary in vitro antiproliferative studies showed that the algal extracts displayed high cytotoxic activity against a panel of cancer cell lines. The most potent activity was recorded against MCF-7 with IC values of 51.37 ± 1.19, 63.44 ± 1.13, and 59.70 ± 1.22 µg/mL for , , and , respectively. The cytotoxicity of the algae was selective to MCF-7 without showing notable effects on the proliferation of normal human WISH cells. Morphological studies revealed that the algae caused cell shrinkage, increased cellular debris, triggered detachment, cell rounding, and cytoplasmic condensation in MCF-7 cancer cells. Mechanistic investigations using flow cytometry, qPCR, and Western blot showed that the algae induced apoptosis, initiated cell cycle arrest in the sub-G/G phase, and inhibited the proliferation of cancer cells via increasing mRNA and protein expression of p53, while reducing the expression of PI3K, Akt, and mTOR.