The Application of Meta-Analytic SEM on Exploring Factors that Influence Teachers’ Usage of Interactive Whiteboard

Citation: (2019). The Application of Meta-Analytic SEM on Exploring Factors that Influence Teachers’ Usage of Interactive Whiteboard. ABSTRACT Background: Interactive whiteboard (IWB) is an important tool in computer-assisted instruction (CAI). Interactive whiteboard is an electronic instructional and interactive technology designed by use for teachers. Some studies declare that teachers’ behaviors in using interactive whiteboard only be infected by perceived usefulness, for teachers are a relatively profession. Material and methods: This paper integrated the 27 studies that used technology acceptance model (TAM) with meta-analytic structural equation modelling (Meta-Analytic SEM). Results: The estimate of perceived usefulness (PU) to Perceived ease of use (PEOU) is 0.585 (p-value<0.001). The estimate of PU to attitude (ATT) is 0.693 (p-value<0.001). The estimate of PU to behavioral intentions (BI) is 0.573 (p-value<0.001). The estimate of PEOU to ATT is 0.663 (p-value<0.001). The estimate of PEOU to BI is 0.549 (p-value<0.001). The estimate of ATT to BI is 0.663 (p-value<0.001). Conclusions: PEOU has a positive effect on PU and ATT toward using interactive whiteboard. PU has a positive effect on attitude toward using interactive whiteboard and BI to use interactive whiteboard. Attitude toward using interactive whiteboard has a positive effect on and BI to use interactive whiteboard.


INTRODUCTION
Information technology is rapidly changing the way people live and work, and the field of teaching is no exception. Educational institutions have tried to provide students better learning environments by equipping them with the latest technology. This effort has encouraged instructors to use various assistive technologies such as multimedia and the Internet in their classrooms especially over the last decade, and this integration process of information technologies and education is called computer-assisted instruction (CAI) (Hsu, 2010). As a part of the integration process, the interactive whiteboard (IWB) is one of the important topics of CAI (Holmes, 2009).An interactive whiteboard (IWB) is defined as a touch-sensitive board, linked to a computer and a digital projector. The computer can be commanded by touching the board, directly also with a particular pen. The projector can then show images from the computer on the board (Zhang, 2019). Interactive whiteboards had the potential to be identified with new digital classrooms just as blackboard played a key role in traditional classrooms. Interactive whiteboards can have many positive effects on teaching and learning in general. For teachers, during regular class hours, they provide the opportunity to integrate more information technologies into lessons, enable teachers to utilize a wide range of web-based resources, and encourage them to save and print their notes that they make during lessons. Singaravelu (Singaravelu, 2017) indicated that teaching with interactive whiteboard is more convenient for teachers and students compared with teaching by a traditional board. According to Gashan and Alshumaimeri (2015), although some teachers pointed out that they lacked sufficient training in using interactive whiteboards, most of them agreed positively that the interactive whiteboard does not scare them and makes teaching more comfortable. The most importantly, online tools and digital devices in schools have led to educators' increased use of interactive whiteboards in teaching and learning. Teachers must use technology efficiently and bring new pedagogies to their instruction.In many countries, huge amounts of declared funding has been assigned to education sectors for promoting interactive whiteboards in classes, particularly in the elementary school and high school (Taylor and Todd, 1995). Associated studies have proven that interactive whiteboards with the interactive features will attract students' attention and increase concentration. Some studies (Olivares and Castillo, 2018) indicated that interactive whiteboards strengthen students' motivation in learning. The teachers' attitudes and technological skills effects motivation significantly (Tosuntaşa, Karadağa, and Orhanb, 2015). When teachers understanding that interactive whiteboard technology is easy to use and could improve the quality of teaching in classrooms, teachers will use interactive whiteboard in their classes. Emerging evidence implies that teachers' preparation and students' attitudes influence the virtue of technology-enabled learning surroundings. DiGregorio, and Sobel-Lojeski indicated that pedagogy, technical, attitude and curriculum issues are main concerns for developing advisers' CAI teaching skills (DiGregorio and Sobel-Lojeski, 2010). In recent years, the interactive whiteboard is a relatively new CAI tool introduced into classrooms. Researchers had found that many benefits of using them to develop into enhancing students learning experiences in the future (Olivares, Castillo, 2018). Wong, Teo, and Russo (2013) further indicates that providing proper training is the best significant way to help teachers to successfully use interactive whiteboards in their classrooms. In the beginning, training is usually offered by enterprises or interactive whiteboard suppliers, which is not enough for most beginner adopters (Wong, Teo, and Russo, 2013). That means additional formal training conferences and informal learning courses should be organized to make sure that teachers realize how to effectively use interactive whiteboards.With the theory of reasoned actions (TRA), technology acceptance model (TAM) addresses factors influencing a user's attitude toward using and their intention to use technology (Davis, Bagozzi, and Warshaw, 1989). TAM has been widely adopted in studies exploring technology acceptance due to its parsimonious nature and highly reliable constructs. Examples include studies testing user acceptance of mobile devices in learning (Al-Emran, Mezhuyev, and Kamaludin, 2018), e-learning (Abdullah and Ward, 2016), NXT robot in learning (Shin, Shih, Li, Chen, Chen, and Chen, 2011), and interactive whiteboard (Wong, Teo, and Russo, 2013).TAM considers perceived usefulness (PU) and perceived ease of use (PEOU) as two major factors influencing a user's behavioral intention (BI) in using new technology (Šumaka and Šorgoab, 2016). The former refers to the perceived effectiveness of improving the user's performance, while the latter refers to how effortless a user perceives using the technology to be. Prior research has found that PEOU mostly influences attitude and intention indirectly through PU (Wong, Teo, and Russo, 2013). Perceived usefulness and user attitude in turn influence intention to use, which predicts actual usage of technology. Based on TAM model (Davis, Bagozzi, and Warshaw, 1989), PEOU and PU positively affect users' attitude in using interactive whiteboard; and PEOU positively affect users' ATT. The result of Huang (Kuo, 2017), Chiang (2017), Hsueh (2013), and Li (2012)'s study is consistent with the TAM model. However, some studies (Kung, 2010;Ou, 2010) indicated that PEOU does mot positively affect users' attitude toward using (ATT) in the usage of interactive whiteboard. They claimed that the usefulness of technology plays a more important role than the ease of use in affecting teachers' decisions to use new information technology, because teachers are capable of learning new technology quickly and thus perceived ease of use is not very important.The combining of SEM and meta-analysis improves the estimation of structural equation models. SEM requires large sample sizes while combining the information from many samples and studies. Studies without the integration of these two methods can only give partial solution to the research questions. Integration of SEM and meta-analysis can acquire a more complete set of hypotheses and estimated parameters (Cheung, 2015;Jak, 2015).The main objective of this study is to integrate existing research that used theory-based TAM models through the general framework of metaanalytic structural equation modelling (meta-analytic SEM). This integration enables a more accurate interpretation of modeling results in a broader context of data and a comparison of the findings based on primary data.

MATERIALS AND RESEARCH METHOD
In Davis, Bagozzi, and Warshaw's study (1989), behavioral intentions to use (BI), attitude toward use (ATT), perceived usefulness (PU), and perceived ease of use (PEOU) are integrated. Figure 1 shows the research framework of this present study in a TAM model. From this figure, we can find that 1) PEOU, and PU positively affect users' attitude in using interactive whiteboard (H2, and H3). 2) PEOU positively affects users' ATT (H1). 3) PU and ATT positively affects users' behavioral intentions to use interactive whiteboard (H4, and H5).

Data Source
For enough information (such as covariance matrix, observed variables, and questionnaires) for Meta-Analytic SEM, this study only focus on master thesis and doctoral thesis. This present paper selected 27 studies that published after 2010 from Taiwan Theses and Dissertations Knowledge Value-Added System (Taiwanese National Central Library, 2010) to do meta-analysis. All these 27 studies explored Taiwanese teachers' behaviors in using interactive whiteboard is as shown in Table 1.  (Davis, Bagozzi, and Warshaw, 1989)

Meta-analytic SEM
Meta-analytic SEM is an extension of the classical individual structural equation modeling. It aims to solve the important scientific problem of integrating, combining and comparing research findings. The meta-analysis is a statistical analysis of a large collection of analysis results from individual studies for the purpose of integrating the findings (Glass, 1976). It can generalize findings across studies, identify potential moderators in the model structure and obtain the appropriate estimates given a larger sample sizes. Structural equation modeling is a powerful statistical method for estimating multivariate regression models with latent variables that combines regression analysis with confirmatory factor analysis.
Meta-analytic structural equation modeling usually is applied as a two-stage approach. In stage 1, the homogeneity of correlation matrices is tested and pooled correlation matrix is estimated. In stage 2, SEM models based on pooled correlation matrix are estimated. Estimation of pooled correlation coefficients in univariate approach is given as a weighed correlations or weighed Fisher-z scores.
The univariate approach is not broadly recommended because not all studies include all variables, and this problem will cause lack of precision in the estimation. In the multivariate approach, the generalized least squares (GLS) or two-stage structural equation modeling that is based on all correlation coefficients and their dependence is used. In meta-analytic structural equation modeling, the two-stage approach gains more popularity because it uses the multi-group structural equation modeling to pool correlation coefficients.
The three approaches of meta-analytic SEM include fixed-effect model, random-effect model, and mixed-effect model (Cheung, 2015).
In fixed-effect SEM, the effect sizes (correlations, covariance, path coefficients etc.) are assumed to be comprehensive summaries of many effect sizes and their estimated sampling variance (differences between studies are the result of sampling error only). If effect sizes are homogeneous across studies, the weighted average of effects is the unbiased estimate of the population effect size that share the common value.
The random-effect SEM assumes that studies are not simple replication of each other and the effect size may vary due to differences in samples and methods used in different studies. The random-effect SEM can be used where the researchers wish to make inferences and generalizations on the studies used in the analysis. Randomeffect SEM models include not only sampling variance, but also the between-studies variance components.
The mixed-effect model is used with covariate and it includes both fixed and random effects. The fixed effects are due to the study-specific covariates, and the random effects are the unexplained study-specific effects after being controlled for the covariates.

RESULTS
This paper integrated the 27 studies that used TAM models with Meta-analytic SEM, which was proposed by Davis, Bagozzi, and Warshaw (1989). The estimations were calculated using R 3.5.3 with the algorithm in Cheung's study (2014). This present paper only integrated the 1st generation TAM (Davis, Bagozzi, and Warshaw, 1989), which includes perceived ease of use (PEOU), perceived usefulness (PU), attitude towards use (ATT), and behavioral intention of use (BI).
Given the correlations, two-stage SEM was applied in obtaining pooled correlation matrix for subsequent TAM model. Both fixed-effect and random-effect models were estimated. In the fixed-effect model, the pooled correlation coefficients were calculated as unbiased estimates of population correlation matrix.
The result of fixed-effect model is as Table 2.  The fit indices for testing the homogeneity of the correlation matrices in Table 2 are X 2 (df=18; N=819) =56.3759; p<0.0001, CFI=0.9762, TLI=0.9683, SRMR=0.0518, and RMSEA=0.1021. These values indicate that it is not reasonable to assume that the correlation matrices are homogeneous.
The result of random-effect model is as Table 3. In the random-effect model, the intercepts (effect sizes) and random effects (tau) were calculated. Table 3 presents the average (pooled) correlations (Intercept) and betweenstudy variances of correlation coefficients as random effects (Tau). Additionally, the random effect model provides the Q tests of effect sizes for the homogeneity across studies. The estimate of PU to PEOU is 0.6034 (Wald CI: 0.5557 ~ 0.6511). The estimate of PU to ATT is 0.7155 (Wald CI: 0.6668 ~ 0.7643). The estimate of PU to BI is 0.5972 (Wald CI: 0.5098 ~ 0.6847). The estimate of PEOU to ATT is 0.6724 (Wald CI: 0.6263 ~ 0.7185). The estimate of PEOU to BI is 0.5674 (Wald CI: 0.4953 ~ 0.6395). The estimate of ATT to BI is 0.6801 (Wald CI: 0.6399 ~ 0.7204).
In Table 4, the Q statistic (58.94208; p-level<0.001) shows that the hypothesis concerning homogeneity of correlations across studies should be rejected. The heterogeneity indices based on Q statistic also provide the information about strong heterogeneity of correlation coefficients. The random-effects model is more appropriate than the fixed-effects model for this data set.
Because of correlation coefficients heterogeneity, the random-effect model was selected for the stage 2 solution. In stage 2, the TAM structural equation model based on pooled correlation matrix was estimated using R 3.5.2 and the path weight is calculated based on Cheung's study (Cheung, 2014).
The result of random-effects meta-analysis is in Table 5. The goodness of model fit is acceptable. The aggregate sample size is 819. Chi-square of target model is 5.2133 with df=1 and p-value=0.0224. The RMSEA is marginally acceptable 0.0718 (CI: 0.0217~0.1373) and comparative fit indices TLI and CFI are 0.9857 and 0.9976 respectively. The parameters of the TAM model depicted in Figure 2 were used as an a priori information for meta-analytic SEM model on primary data.   Figure 2 and Table 5 show that the effects of PEOU on PU and ATT are 0.61226 and 0.39502, the effects of PU on ATT and BI are 0.47104 and 0.27625, and the effect of ATT on BI is 0.49006. All of these effects are statistically significant.
In Figure 1, PEOU and BI are mediators of the effect of PEOU on BI, and the indirect effects are via PU and ATT separately. The results demonstrate that the indirect effects via PU and ATT are 0.16914 and 0.19358 respectively. All of these effects are statistically significant ( Table 6).
From the result of this study presented in Table 7, it has been found that first, perceived ease of use (PEOU) has a positive effect on perceived usefulness (PU) and attitude toward using interactive whiteboard (ATT) (H1 and H3). Second, perceived usefulness (PU) has a positive effect on attitude toward using interactive whiteboard (ATT) and behavioral intentions to use interactive whiteboard (BI) (H2 and H4). Third, attitude toward using e interactive whiteboard (ATT) has a positive effect on and behavioral intentions to use interactive whiteboard (BI) (H5).

CONCLUSIONS
Past studies on the use of new information technology focused on system development and behavioral intention to use it. However, with rapid development and popularity of information systems, discussion on the interactive whiteboard should not be centered merely on technological perspectives, since technologies continuously evolve and will reach maturity in the end. Many previous studies (Wong, Teo, and Russo, 2013) discussed the factors that affect teachers' behaviors in using interactive whiteboard with the TAM model proposed by Davis, Bagozzi, and Warshaw (1989), and they indicate that perceived usefulness and perceived ease of use play an import role in teachers' behaviors in using interactive whiteboard. But some studies (Kung, 2010;Ou, 2010) declare that teachers' behaviors in using interactive whiteboard only be infected by perceived usefulness, for teachers are a relatively small profession.
The objective of this research is to find out factors affecting teachers to use Interactive Whiteboards in classes with Meta-Analytic SEM. The integration of meta-analysis and SEM models provides a powerful tool for a model generation and parameter check. From the result of the integration of these 6 studies, it can be found that TAM model is a suitable model in discussing factors that affect teachers' behaviors in using interactive whiteboard. Perceived usefulness and perceived ease of use improve teachers' behaviors in using interactive whiteboard significant. Some studies (Kung, 2010;Ou, 2010) that are inconsistent with Davis, Bagozzi, and Warshaw's TAM model (Davis, Bagozzi, and Warshaw, 1989) may result in insufficient sample size or data bias.
Adult learning theory revealed that linking adult learners' previous experiences can stimulate to their reflective thinking when they are learning. What is more, when adult learners understand the technological tool can help solving their problems that can increase their learning motivation (Lowe and Holton, 2005).
It is important to develop a school culture and establish teaching counseling group, that would help teachers to shape the perception that would like them to use technology (Yuen, Ma, 2008). School directors should periodically hold the teaching observations. Teaching observations provide an opportunity to benefit both teachers and observers. Those teachers have not applied interactive whiteboard in teachers can have different experience, thus induce his/her interests. It's also a good way to show functions of interactive whiteboard and how to use it in lecturers.
As Slay, Sieborger, and Hodgkinson-Williams (2008) argue, teachers' understanding and practices is necessary to make optimum use of the promising technology tool. Conferences of teaching and training workshops can help teacher to gain confidence and skills with the interactive whiteboard technology (Merriam and Caffarella, 2007). In order to widely promote interactive whiteboard to every basic level school, all teachers have to be familiar with this technology. Therefore, administration of education is suggested to hold exhibitions, teaching observations and references for teachers of elementary and junior schools. If teachers feel interactive whiteboard is usefulness and ease of use and become acquainted with it, they will have higher willing to apply interactive whiteboard in teaching.
This study targets only on the teachers who serve in Taiwan. Due to the digital divide between the Eastern and Western countries and the different cultures, the result of this research fits to those East countries with Chinese culture.