The fatigue life of the riveted structure greatly depends on the meso-cracks around the hole and the crack expansion. Furthermore, the riveting process parameters have significant effect on the initiation and growth of the mesocracks. It is analyzed that how these parameters affect the mesoscopic quality of the areas around the hole in this paper. There are three parameters used to describe the mesoscopic structure around the hole. Here MR represents the fillet radius of the area where the panel touches the riveting head and rod. MD and Md are both the parameters for the plastic layer thickness around the hole. The effects of some riveting process parameters on the above three characterization parameters for the meso-structure around the hole are researched respectively, including riveting force, riveting process time and upper riveting cavity. This study helps to polish up the quality of the meso-structure through adjusting riveting process parameters, and get further improvements on the fatigue performance of the riveted structure.