Ideal biomaterials for bone grafts must be biocompatible, osteoconductive, osteoinductive and have appropriate mechanical properties. For this, the development of synthetic bone substitutes mimicking natural bone is desirable, but this requires controllable mineralization of the collagen matrix. In this study, densified collagen films (up to 100 μm thick) were fabricated by a plastic compression technique and cross-linked using carbodiimide. Then, collagen-hydroxyapatite composites were prepared by using a polymer-induced liquid-precursor (PILP) mineralization process. Compared to traditional methods that produce only extrafibrillar hydroxyapatite (HA) clusters on the surface of collagen scaffolds, by using the PILP mineralization process, homogeneous intra- and extrafibrillar minerals were achieved on densified collagen films, leading to a similar nanostructure as bone, and a woven microstructure analogous to woven bone. The role of collagen cross-links on mineralization was examined and it was found that the cross-linked collagen films stimulated the mineralization reaction, which in turn enhanced the mechanical properties (hardness and modulus). The highest value of hardness and elastic modulus was 0.7 ± 0.1 and 9.1 ± 1.4 GPa in the dry state, respectively, which is comparable to that of woven bone. In the wet state, the values were much lower (177 ± 31 and 8 ± 3 MPa) due to inherent microporosity in the films, but still comparable to those of woven bone in the same conditions. Mineralization of collagen films with controllable mineral content and good mechanical properties provide a biomimetic route toward the development of bone substitutes for the next generation of biomaterials. This work also provides insight into understanding the role of collagen fibrils on mineralization.