Silt fines are fine aggregate particles smaller than the 75 μm (No. 200) sieve. Usually, they are either silts or clayey silts, and are difficult to remove from the aggregate surface. Considering the high proportion of silt fines found in the river sands of Taiwan, this research investigates the impact of the material on the properties of concrete. Concrete specimens with a w/c ratio of 0.48 and different silt content of fine aggregate, ranging from 0% to 9%, were cast and tested in this study. Moreover, chloride transport tests were conducted to investigate the properties of concrete. Test results indicate a decrease in durability when the ratio of silt content to fine aggregate exceeds 5%. The compressive strength, however, when silt fine content is small than 5%, increases only 1 MPa. But decreases from 3 MPa to 5 MPa when the silt content increases from 7% to 9%. These results could serve as a reference in concrete production as well as quality control of fine aggregate containing a large amount of silt fines.