Abstract: To address the lack of calibration and performance evaluation methods for anesthetic depth monitoring devices, a new approach is proposed that utilizes real clinical electroencephalogram (EEG) signals to assess the measurement results of anesthetic depth indices. Using a custom-built anesthetic depth monitoring device testing system, EEG signals from young and elderly patients under anesthesia were input into three anesthetic depth monitoring devices, namely BIS index, CSI index, and Ai index. The consistency and repeatability of the measurement results were calculated and evaluated, and the correlation between the indices and the EEG signal spectrum was analyzed. The three indices showed good overall consistency in reflecting the changes in anesthetic state, but significant differences were observed during the anesthetic transition state and in samples from elderly patients. The results indicate that this method can be used for testing the three anesthetic depth monitoring devices and provides guidance for conducting metrological quality control of these devices.