In this study,weather variables(air temperature,pressure,wind speed,relative humidity,ground temperature etc.) collected from an experimental double-set automatic weather station(noted as stations A and B) and the home station(noted as station Z) were comparatively analyzed at Yixian,Huangshan,Anhui Province in February,2011.The data continuity before and after the new double-set automatic weather station was extensively evaluated.The assessment factors were data integrity and difference.The data difference was evaluated by the average,standard deviation,error rate,the gross error rate and concordance rate.The comparative analysis shows the following:(1)The double-set automatic weather station data are of high reliability,the receiving rate of most of the variables reaches up to 100%,but the receiving rate of relative humidity at station B is as low as 83.3%,due to the failure of the relative humidity module of said station.(2)The observation data from the double sets have high concordance rates for many variables,but the concordance rates are relatively low for the ground temperature differences of station-pairs AB and AZ,and for the pressure difference of station-pair AB.Some additional differences also existed.(3)The T-test results show that the data from double-set automatic weather station have no significant difference compared to the historical data series,and the continuity is very good.(4)The double-set of the automatic weather station is demonstrated to fit for weather observation operation,but parallel work with the home station should be performed for a certain time,in order to obtain more reference data for future analysis and calibration.