The steepness of the delay discounting function shows considerable interindividual differences. Moreover, faster devaluation of future rewards has been consistently observed in pathological gamblers (PGs). Here, we asked whether variability in delay discounting is at least partially driven by differences in the anatomy of gray and white matter. For 40 healthy young subjects (study 1) as well as 15 PG and 15 age-matched healthy controls (HCs, study 2), the individual discounting parameter k was obtained. Based on 3D T1-weighted high-resolution magnetic resonance scans and diffusion tensor imaging, we performed voxel-based morphometry and tract-based spatial statistics, respectively, to examine the relation of gray matter volume (GMV) and white matter properties (as indicated by fractional anisotropy, FA) to k. Healthy groups from both studies showed a negative correlation between k and FA for the superior longitudinal fascicle and inferior longitudinal fascicle, whereas a positive correlation was found in the PG group for the inferior longitudinal fascicle and left inferior fronto-occipital fascicle. The latter also was significantly different between HC and PG in the group statistics (albeit on the right side), thus suggesting that this is a significant structure for the development of pathological gambling. GMV of the right frontal orbital cortex, left insular cortex and right lateral occipital cortex showed a positive correlation to k HC (studies 1 and 2) and PG, whereas a negative correlation was found for the left frontal pole in all three groups. Group comparison of GMV (study 2) revealed a decrease in PG for several cortical and subcortical areas.