This paper present a microstructure-based finite element model by incoerporating elastic aggregrates and vicoelastic sand mastic. The microstructure-based finite element (FE) approach was used to predict the linear and damage-coupled viscoelastic properties of reclaimed asphalt mixture. The two-dimentional (2D) microstructure of asphalt mixture pavement (RAP) mixture specimen. In the microstructure, the sketches of highly irregular aggregates were converted into polygons. The whole microstructure model was divieded into highly irregular aggregate and sand mastic subdomains. The finite element mesh wa generated within each subdomain. The deformation of the aggregrate and damage-coupled viscoelastic finite element model was developed with displacement-based incremental formulation. The linear and damage-coupled viscoelastic simulation was conducted on the image sample of test specimen under different sinusoidal force loading frequencies. The uniaxial compression simulation result showed creep deformation constant cyclic force loading amplitude and damage-coupled viscoelastic responses have larger creep deformation. Simulations under different loading frequencies found compression strain deceases with loading frequencies due to less relaxation time.