The rationale for the present study was to develop porous CaP/silk composite scaffolds with a CaP-phase distribution and pore architecture better suited to facilitate osteogenic properties of human bone mesenchymal stromal cells (BMSCs) and in vivo bone formation abilities. This was achieved by first preparing CaP/silk hybrid powders which were then incorporated into silk to obtain uniform CaP/silk composite scaffolds, by means of a freeze-drying method. The composition, microstructure and mechanical properties of the CaP/silk composite scaffolds were ascertained by X-ray diffraction (XRD), Fourier transform infrared spectra (FTIR), scanning electron microscope (SEM) and a universal mechanical testing machine. BMSCs were cultured in these scaffolds and cell proliferation analyzed by confocal microscopy and MTS assay. Alkaline phosphatase (ALP) activity and osteogenic gene expression were assayed to determine if osteogenic differentiation had taken place. A calvarial defect model in SCID mice was used to determine the in vivo bone forming ability of the hybrid CaP/silk scaffolds. Our results showed that incorporating the hybrid CaP/silk powders into silk scaffolds improved both pore structure architecture and distribution of CaP powders in the composite scaffolds. By incorporating the CaP phase into silk scaffolds in vitro osteogenic differentiation of BMSCs was enhanced and there was increased in vivo cancellous bone formation. Here we report a method with which to prepare Ca/P composite scaffolds with a pore structure and Ca/P distribution better suited to facilitate BMSC differentiation and bone formation.