In this paper, the experiments on grinding of particle-reinforced titanium matrix composite (PTMCs) were conducted using single-layer brazed CBN wheels. The comparative grinding performance was studied in terms of grinding force and grinding temperature by grinding of PTMCs and TC4 titanium alloy. The evolution process of PTMCs material removal was discussed by the finite element method. The results show that the grinding forces for PTMCs are always 15%–30% higher than that for TC4. The grinding temperature for PTMCs is always 7%–11% higher than that for TC4. PTMCs is more difficult to machine than TC4 titanium alloy. The material removal process of PTMCs includes the ductile removal of TC4 matrix material and the brittle removal of TiC reinforced particles. The hole defect on the grinding surface is created by the brittle removal. When the grinding speed decreases from 120 m/s to 20 m/s, the depth of the hole defect on the ground surface increases from 0.8 μm to 3.5 μm, an increase of about 3.4 times. The influence of reinforced particle brittle removal on PTMCs ground surface hole defects can be reduced by increasing the grinding speed.