This study was conducted to investigate the use of oil palm fruit ash-modified bitumen (OPFA-MB) as a binder in stone-mastic asphalt (SMA) mixtures. The OPFA was used to take advantage of a waste by-product of the palm oil milling industry which could help to reduce environmental pollution. Binder tests such as penetration, softening point, viscosity, storage stability, dynamic shear rheometer (DSR), bending beam rheometer (BBR), and the direct tension test (DTT) were conducted on both unmodified and OPFA-modified bitumens. It was found that the properties of unmodified bitumen improve when OPFA is added. In addition, several asphalt mixture tests, including the Marshall Stability test, indirect tensile modulus resilience test, static uniaxial creep test, wheel tracking test, static-immersion and boiling water test, and drain-down test, were also performed on SMA mixes. The presence of OPFA was observed to enhance the stability, resilient modulus, and rut resistance of SMA mixes compared to the unmodified bitumen. This material was also found to be a good alternative material for fiber replacement in SMA mixes.