Few studies have investigated the relationship between sarcopenia and mild to moderate renal decline. This study aimed to investigate the relationship between chronic kidney disease (CKD) and sarcopenia. In total, 123 patients hospitalized with CKD and 57 healthy volunteers who underwent physical examination during the same period (control group) were analyzed. Body compositions were measured by dual-energy X-ray absorptiometry, and the relative appendicular skeletal muscle index (RASMI) was calculated. Muscular strength was evaluated using hydraulic hand dynamometer. Walking speed within 6 m was measured for muscular function assessment. Single-photon emission computed tomography was performed to measure the glomerular filtration rate of CKD patients, who were then divided into CKD1 (55 patients in CKD stages 1 and 2) and CKD2 (68 patients in CKD stages 3–5). RASMI showed a downward trend with CKD progression (P = 0.001). Multivariate logistic regression analysis showed that age and CKD progression were independent risk factors for sarcopenia. The morbidity of sarcopenia was significantly greater in CKD patients than in healthy volunteers, and the degree of muscle loss was closely related to CKD progression.