Vibrating screens are critical equipment for achieving effective mineral classification and clean, efficient utilization. The motion characteristics of particles on screen panels under different vibration modes significantly influence their screening efficiency and processing capacity. However, there is limited research on the separation mechanism and kinematic characteristics of particle systems on screen panels. In this study, explicit dynamics particle generation technology was employed to establish a kinematic simulation model of the screen panel and particle system using the finite element method (FEM) and discrete element method (DEM). The separation mechanism of particle systems on screens with different vibration modes was described from a macroscopic physical perspective. The dynamic characteristics of particles in various size fractions on the screen were analyzed, and the influence law of mineral particle mass on the kinematic characteristics of screening equipment was explored. The research results indicate that during the screening process, particles achieve the separation of materials with different particle sizes on the screen through percolation and convection mechanisms. The vibrating flip-flow screen (VFFS) can achieve particle separation more rapidly than traditional vibrating screens. Moreover, when the mass of mineral particles on the screen panel increases, the activity of particles on the VFFS panel is most significantly affected. The time required for fine particles on the screen panel with different vibration modes to completely pass through the screen increases linearly with the increasing mass.