Studies of cerebral asymmetry can open doors to understanding the functional specialization of each brain hemisphere, and how this is altered in disease. Here we examined hemispheric asymmetries in fiber architecture using diffusion tensor imaging (DTI) in 100 subjects, using high-dimensional fluid warping to disentangle shape differences from measures sensitive to myelination. Confounding effects of purely structural asymmetries were reduced by using co-registered structural images to fluidly warp 3D maps of fiber characteristics (fractional and geodesic anisotropy) to a structurally symmetric minimal deformation template (MDT). We performed a quantitative genetic analysis on 100 subjects to determine whether the sources of the remaining signal asymmetries were primarily genetic or environmental. A twin design was used to identify the heritable features of fiber asymmetry in various regions of interest, to further assist in the discovery of genes influencing brain micro-architecture and brain lateralization. Genetic influences and left/right asymmetries were detected in the fiber architecture of the frontal lobes, with minor differences depending on the choice of registration template.