The deformation behavior of hot mix asphalt (HMA) in the indirect tension test (IDT) is simulated using the discrete element method (DEM). The internal structure of the HMA is described using two sets of discrete particles representing the aggregates and the binder. The constitutive behavior of these materials is defined using linear elastic properties along with a damage model to capture debonding. Different adhesion and cohesion strength ratios are included in the analysis along with varying binder film thicknesses. The analysis revealed that cracking has the tendency to occur at the interface between the aggregate and the binder due to the high concentration of stresses in that region. Furthermore, it is noticed that models containing thin films of binder are more sensitive to the adhesive bond strength than those containing thick films of binder. The latter suggests that adhesive failure is more critical in thin film specimens, whereas cohesive failure is more critical in thick film specimens.