The morphology characteristics (sphericity, roundness, and surface roughness) affecting the destruction of gangue minerals on graphite flakes during the grinding process were systematically analyzed. Coupled with MS and SEM, sphericity analysis showed that graphite was flaky, which was similar to muscovite but different from granulous quartz and albite, and the roundness of the four minerals from high to low was graphite, quartz, albite, and muscovite. AFM analysis showed that the surface roughness of graphite and muscovite was very low compared to that of quartz and albite (higher than quartz). The size and crystal integrity of graphite flakes were both destroyed by gangues during the grinding process, and the destruction of quartz and albite was serious compared to that of muscovite. Sphericity dominantly affected the destruction: the larger the sphericity, the more serious the destruction, which was also negatively related to roundness but positively related to surface roughness.