監測訪問時間的調查品質管制程序

Monitoring Interview Duration for Survey Quality Control

"社會科學研究常使用問卷進行資料收集，但資料品質與抽樣誤差、調查過程產生的誤差等有關。Biemer和Lyberg（2003）建議使用資料收集過程來監控資料品質。Japec（2005）建議監測訪談的持續時間，以提供有關資料品質的訊息。有好的過程品質，才能得到好品質的資料。以調查周邊資料和時間標記作為資料品質管理，不僅能獲得更高品質的資料且能同時改善操作效率和降低成本。 本研究以2015年「台灣社會變遷基本調查計畫」工作與生活組為例，提出一個以訪問時間為基礎的調查品質管制程序，並將管制圖應用於調查資料品質管制。我們提出的程序包含三個部分：(1)訪員的篩選程序，利用主成分分析法依據訪問時間將訪員分類；(2)決定檢查比例的程序，依據訪員分類配置不同的檢查比例；(3)訪員個人監測程序，運用個人中位數管製圖選取檢查樣本。此研究目標不是簡單的監測，而是提供持續品質改善的程序，且能更有效的掌握檢查作業成本，以兼具品質改善與成本控管。"

"To collect data in social sciences, it is common to use question-naire survey methods. Data quality is essentially a function of the mag-nitude of error in data. If data have sufficient accuracy, it is said that the data quality is high. On the other hand, if the magnitude of error in data is large, the data are said to have poor quality. These criteria for data quality can be applied when using data to estimate population param-eters. There are two forms of error in estimating parameters. The first, known as sampling error, is the error as a result of drawing a probability sample rather than conducting a complete enumeration. The second, known as nonsampling error, refers to all other forms of error that can occur during data collection and processing procedures. Therefore, efforts to improve data quality are directed at nonsampling error. Biemer and Lyberg (2003) provide an extensive discussion of methods for data quality improvement. They suggest focusing on steps to improve the data collection process. Often a good-quality process implies good quality of both the data sampled and the resulting output. Using paradata and time stamps to manage survey data collection can lead to a more efficient operation that produces higher quality data at lower cost. In this study, we explore the effect of interview duration on data quality in the Taiwan Social Change Survey (TSCS). The TSCS, the first nationally representative survey in Taiwan, was established in 1985 and is conducted through face-to-face interviews. In it, interview-ers are instructed to perform their tasks according to the key principles of standardized interviewing. If the interviewer complies with standard-ized procedures, an abnormal interview duration is less likely. Con-versely, if the interviewer deviates from the standardized procedures, there is higher probability of an abnormal interview duration. Interview duration is very important for the interviewer with regard to planning fieldwork activities, and is a factor which influences his or her cost and benefit analysis. Short and well-paid interviews are financially and organizationally more attractive. Japec (2005) suggested monitoring interview duration, since it can tell us something about data quality. This paper addresses the problem of quality control in a survey based on interview duration data, and applies control charts to the moni-toring process. We conducted this process in three parts: (1) classifica-tion of interviewers based on interview duration data using principal components analysis. The aim was to improve the efficiency of monitor-ing the data collection process. (2) detection of the optimal rate among different interviewers’ classifications, and avoidance of continually collecting data by using non-standard interview procedures which affect the quality of survey data. (3) use of a median control chart to monitor the potential causes of variation between individual interviewers to find out why some interviewers’ interview times exceed the control limit. To assess the applicability of the proposed method, we used the 2015 Work and Life module of the TSCS to illustrate the proposed process for survey quality control. The research goal of this article was not simply to monitor, but also to improve the quality of the process over time. Based on the proposed process, it is notable that the inspection operation cost can be more effectively controlled."