
1(/,212)((&,1/(51,1
&21(16,1((%22.&,(6.,//6
)255(,1)52(3(563(&,(62)
/(&5(5616(16()&/2)
(1/,612,23(11,(56,
DQDQKXDW
XLHXKX
(PDLOWKXDWWYKRXHGXYQ
5HFHLYHG
5HYLVHG
FFHSWHG
'2,KRXMV
EVWDFWThisstudywasconductedtondouttheopinionsoflecturersandstudents
abouttheteaching-learningcontentsinthetextbook“ActiveSkillsforReading4”usedtoteach
ReadingSkillslevel6tothird-yearstudentsmajoringinEnglishatHanoiOpenUniversity.
Theauthorusedamixedresearchmethod,combiningquantitativeandqualitativeresearch
methodstoanalyzedata.ThelistoftextbookevaluationchecklistscompiledbyLitz(2005)
andtheauthorsMukundan,Nimehchisalem,andHajimohammadi(2011),afterbeingedited
tosuittheresearchobject,isusedasthemainresearchtool.Eightlecturersandeighty-four
third-yearstudentsmajoringinEnglishatHanoiOpenUniversityparticipatedinthestudy,
andtwoteacherswereinvitedtoparticipateininterviewstoclarifysomeinformation.Thedata
collectedrevealedthatmostsurveyedlecturersandstudentshighlyappreciatedthediversityof
topics,theirinterestinreadingcomprehension,andtheclarityofinstructionsfortheexercises
inthetextbookActiveSkillsforReading4.However,thecriteriaforthediversityofquestion
types,quantityandvarietyofvocabulary,andwayofintroducingvocabularyarenothighly
appreciated.Based on thendings, the interviewed lecturers madesome recommendations
onhowtousethistextbookmoreeectively.Thestudyhashelpfultheoreticalandpractical
contributionstotextbookselection,evaluation,andeectiveuseoftextbooks.
.HRGV:textbookevaluation,exercises,tasks,Activeskillsforreading4,courselearning
outcomes.
DQRL2SHQ8QLYHUVLW
,,WURGXFWLR
7KHUH DUH PDQ IDFWRUV WKDW OHDG
WR VXFFHVVIXO (QJOLVK OHDUQLQJ DQG
FKRRVLQJ WKH ULJKW WH[WERRN LV YHU
LPSRUWDQWFFRUGLQJ WR 0LHNOH
D WH[WERRN SURYLGHV OHDUQHUV ZLWK D
VVWHPDWLF IRFXVHG SODQQHG FXUULFXOXP
DQG VWDQGDUGL]HG NQRZOHGJH FRQWHQW

FFRUGLQJO KRXU DQG KPDGL
DOVRDVVHUW7H[WERRNVDUHWKHPDLQVRXUFH
WKDWFDQLPSDUWNQRZOHGJHDQGLQIRUPDWLRQ
WR OHDUQHUV LQ DQ HDV DQG RUJDQL]HG
PDQQHU 7KHUHIRUH WKH HYDOXDWLRQ RI
WKH WH[WERRN LV DQ LQGLVSHQVDEOH VWHS
7KH TXHVWLRQ LV KRZ LW FDQ EH DVVHVVHG
ZKHWKHU WKH WH[WERRN LV VXLWDEOH IRU WKH
REMHFWLYHVRIDFRXUVHDVZHOODVZKHWKHU
WKH WH[WERRN LV DSSURSULDWH WR WKH QHHGV
DQGUHTXLUHPHQWVRIWKHFRXUVHDQGOHYHO
RIOHDUQHUVRUQRW
7KH WH[WERRN Active Skills for
Reading 4 SXEOLVKHG E &HQJDJH
/HDUQLQJLQhasbeenociallyput
LQWRXVHDWWKH)DFXOWRI(QJOLVKDQRL
2SHQ 8QLYHUVLW IRU 5HDGLQJ DQG
VXEMHFWVIRUUGHDUVWXGHQWVIRUVHYHUDO
HDUV RZHYHU VR IDU QR UHVHDUFK KDV
EHHQ FRQGXFWHGWR HYDOXDWHWKH WHDFKLQJ
OHDUQLQJ FRQWHQW LQ WKLV WH[WERRN 7R
DGGUHVVWKLVLVVXHWKHUHLVDQXUJHQWQHHG
WR FRQGXFW DQ HYDOXDWLRQ RI WKH WH[WERRN
WR GHWHUPLQH LWV VXLWDELOLW WR WKH FRXUVH
OHDUQLQJ RXWFRPHV RI WKH 5HDGLQJ
PRGXOHIRU(QJOLVKPDMRUVDWDQRL2SHQ
8QLYHUVLWLQRUGHUWRSURYLGHVXJJHVWLRQV
IRUEHWWHUXVHDVKPDGLDQG'HUDNKVKDQ
DVVHUWHGWKDWHYDOXDWLQJWH[WERRNV
helps teachers nd suitable textbooks
DQG DOORZV WKHP WR PDNH DGMXVWPHQWV
DQGPRGLIWKHVHERRNVWRPHHWVWXGHQWV
QHHGV
)RU WKH DERYH UHDVRQV WKH DXWKRUV
GHFLGHGWRFDUURXWWKHUHVHDUFKHQWLWOHG
Q HYDOXDWLRQ RI WKH WHDFKLQJOHDUQLQJ
FRQWHQWVLQWKHWH[WERRNFWLYH6NLOOVIRU
5HDGLQJIURPWKHSHUVSHFWLYHRIOHFWXUHUV
DQGVWXGHQWVDW)DFXOWRI(QJOLVKDQRL
2SHQ8QLYHUVLW7KLVUHVHDUFKDLPVWR
D (YDOXDWH WKH WHDFKLQJOHDUQLQJ
FRQWHQWV LQ WKH WH[WERRN FWLYH 6NLOOV
IRU 5HDGLQJ IURP WKH SHUVSHFWLYH RI
OHFWXUHUV DQG VWXGHQWV DW WKH )DFXOW RI
(QJOLVKDQRL2SHQ8QLYHUVLW
E6XJJHVWZDVWRXVHWKHWH[WERRN
WRVXLWVWXGHQWVQHHGVDQGPHHWWKHFRXUVH
OHDUQLQJRXWFRPHV
7R DFKLHYH WKRVH JRDOV WKH DXWKRU
SURSRVHV WZR UHVHDUFK TXHVWLRQV DV
IROORZV
7R ZKDW H[WHQW GR WKH WHDFKLQJ
OHDUQLQJ FRQWHQWV LQWKHFWLYH 6NLOOVIRU
5HDGLQJ IRXU WH[WERRN VDWLVI VWXGHQWV
QHHGV DQG PHHW WKH FRXUVH OHDUQLQJ
RXWFRPHV
RZ VKRXOG OHFWXUHUV XVH
Active Skills for Reading 4 WH[WERRN
WR PHHW VWXGHQWV QHHGV DQG WKH FRXUVH
OHDUQLQJRXWFRPHV
,,/LWHUDWXUHUHYLH
2YHUYLH RI WHWERRN
HYDOXDWLR
2.1.1.Denition
Dierent authors have dierent
YLHZV RI HGXFDWLRQDO HYDOXDWLRQ 7KH
most extended denition of evaluation
KDV SUREDEO EHHQ SURSRVHG E %HHE
ZKRGHVFULEHGHYDOXDWLRQDVWKH
VVWHPDWLFFROOHFWLRQDQGLQWHUSUHWDWLRQRI
HYLGHQFH OHDGLQJDVD SDUW RIWKHSURFHVV
GR D MXGJPHQW RI YDOXH ZLWK D YLHZ WR
DFWLRQ
,Q 7RPOLQVRQV RSLQLRQ
PDWHULDO HYDOXDWLRQ UHIHUV WR DWWHPSWV
WR PHDVXUH WKH YDOXH RI PDWHULDOV
7RPOLQVRQ DOVR VWDWHV WKDW
PDWHULDO HYDOXDWLRQ LV D SURFHGXUH WKDW
LQYROYHV PHDVXULQJ WKH YDOXH RI D VHW
RI OHDUQLQJ PDWHULDO ,Q FRQFOXVLRQ
WH[WERRN HYDOXDWLRQ LV WKH DVVHVVPHQW RI
the suitability of the textbookto specic
UHTXLUHPHQWV LQFOXGLQJ OHDUQHU JRDOV
OHDUQHUFRQWH[WDYDLODEOHUHVRXUFHVHWF

2.1.2. The role of evaluating
teachingmaterials
0DQ PDWHULDOV DUH XVHG WR VXSSRUW
(QJOLVK WHDFKLQJ DQG OHDUQLQJ DFWLYLWLHV
FFRUGLQJWR7RPOLQVRQSS
WH[WERRNV ZRUNERRNV FDVVHWWH WDSHV &'
520VYLGHRVFRSLHVUHSRUWVRUSDVVDJHV
DQGDQWKLQJWKDWUHSUHVHQWVRULQIRUPVDERXW
ODQJXDJH OHDUQHG DUH FRQVLGHUHG WHDFKLQJ
PDWHULDOV RZHYHU LW LV XQUHDVRQDEOH WR
VDWKDWDQGRFXPHQWLVLQYDOLGXQUHOLDEOH
LPSUDFWLFDO DQG XQFOHDU 7KHUHIRUH
HYDOXDWLQJ WHDFKLQJ PDWHULDOV SODV DQ
LPSRUWDQW UROH LQ WKH ODQJXDJH WHDFKLQJ
SURFHVVKPDGHWDO%UDQFK
&XQQLQJVZRUWK 6DE]DOLSRXU
.RRVKD6RRUL-DVPKLGL
,QVWUXFWLRQDO PDWHULDOV QHHG WR EH
FDUHIXOO HYDOXDWHG IRU WKH SXUSRVH RI
GHWHUPLQLQJ WKH UHVXOWV RI WKH WHDFKLQJ
SURFHVV,PSRUWDQWOWH[WERRNHYDOXDWLRQ
VKRXOGEHEDVHGRQFULWHULDDQGSURFHVVHV
)RU H[DPSOH %UDQFK PHQWLRQV
LGHQWLILQJ DVVHVVPHQW VWDQGDUGV
VHOHFWLQJDVVHVVPHQWWRROVHJFKHFNOLVWV
&XQQLQJVZRUWK 0LHNOH
0XNXQGDQ HW DO DQG FRQGXFWLQJ
WKH DVVHVVPHQW &XQQLQJVZRUWK
S DGGV WKDW HYDOXDWLQJ ODQJXDJH
WHDFKLQJ PDWHULDOV WKRURXJKO LV WR
PHHW WKH OHDUQLQJ QHHGV RI OHDUQHUV WKH
UHTXLUHPHQWV RI WKH FXUULFXOXP DQG WKH
WHDFKLQJPHWKRGVDQGOLQJXLVWLFDVSHFWV
2.1.3. Methods of textbook
evaluation
7KH UHVHDUFKHUV GHYLVHG WKH VWDJHV
RIWH[WERRNHYDOXDWLRQ
FFRUGLQJ WR &XQQLQJVZRUWK
WH[WERRN HYDOXDWLRQ KDV WKUHH
VWDJHV SUHXVH LQXVH DQG SRVWXVH
HYDOXDWLRQ
3HXVH HYDOXDWLRQ FFRUGLQJ
WR 7RPOLQVRQ WKLV LV XVXDOO
FRQGXFWHG EHIRUH D WH[WERRN LV XVHG WR
SUHGLFW WKH YDOXH RI D WH[WERRN WR XVHUV
WR KHOS WKHP FKRRVH WKH ULJKW FRXUVH IRU
WKHFRXUVHDQGSXWLWWRXVHLQDSDUWLFXODU
FODVVURRP7KHSUHXVHDVVHVVPHQWVHHPV
themostdicultbecausethereisnoreal
H[SHULHQFHXVLQJWKHWH[WERRN
,QXVH HYDOXDWLRQ DQ evaluation
RI WKH VXLWDELOLW RI WKH FXUULFXOXP LQ
terms of specic requirements,including
OHDUQHUJRDOVOHDUQHUVFRQWH[WDYDLODEOH
UHVRXUFHVHWF&XQQLQJVZRUWK
3RVWXVHHYDOXDWLRQLVDQevaluation
RI WKH VXLWDELOLW RI D WH[WERRN RYHU D
SHULRG RI FRQWLQXRXV XVH FFRUGLQJ WR
7RPOLQVRQWKLVWSHRIDVVHVVPHQW
FDQ EH WKH PRVW YDOXDEOH EHFDXVH LW FDQ
measure theactual eect ofthetextbook
RQ XVHUV (YDOXDWRUV FDQ PDNH UHOLDEOH
GHFLVLRQVDERXWWH[WERRNXVHDGDSWDWLRQ
RUUHSODFHPHQWEDVHGRQPHDVXUHGGDWD
7KH DERYH H[SODQDWLRQV RI WKH
UHVHDUFKHUV VXJJHVW WKDW WKH HYDOXDWLRQ RI
documents can be done exibly as long as
QHFHVVDU RZHYHU SRVWXVH DVVHVVPHQW
yields better results because it fullyreects
FRJQLWLRQ&XQQLQJVZRUWK7KDWLVDOVR
WKHUHDVRQZKZHDSSOWKLVIRUPWRHYDOXDWH
WKHWH[WERRNFWLYH6NLOOVIRU5HDGLQJ
QXPEHU RI UHVHDUFKHUV KDYH
SURSRVHG ZDV WR GHYHORS D UHOLDEOH
IUDPHZRUN IRU PDWHULDOV HYDOXDWLRQ
6RPHRIWKHPRVWSRSXODURQHVDUHWKRVH
VXJJHVWHG E XWFKLQVRQ DQG :DWHUV
/LWWOHMRKQ 0F 'RQRXJK
DQG6KDZ&XQQLQJVZRUWK
(OOLV /LW] DQG 0XNXQGDQ
HW DO ,Q WKLV VWXG EDVHG RQ WKH
OLVW RI WH[WERRN HYDOXDWLRQ FULWHULD RI
/LW] DQG 0XNXQGDQ HW DO
WKH DXWKRU PDGH VRPH DGMXVWPHQWV WR
VXLW WKH UHDOLW RI WHDFKLQJ DQG OHDUQLQJ
SUDFWLFHVDWWKH)DFXOWRI(QJOLVKDQRL

2SHQ8QLYHUVLWZKHUHWKHUHVHDUFKZDV
FRQGXFWHG
,Q /LW]V OLVW RI WH[WERRN
HYDOXDWLRQFULWHULDWKHUHDUHDWRWDORI
criteria divided into dierent sections:
3UDFWLFDO &RQVLGHUDWLRQV /DRXW DQG
'HVLJQFWLYLWLHV6NLOOV/DQJXDJH7SH
7RSLFDQG&RQWHQWDQG&RQFOXVLRQ(DFK
FULWHULRQLVHYDOXDWHGRQDOHYHOVFDOHLQ
ZKLFKOHYHOHTXDWHVWRGLVDJUHHVWURQJO
DQGOHYHOHTXDWHVWRDJUHHKLJKO:LWK
WKH OLVW RIWH[WERRN HYDOXDWLRQFKHFNOLVWV
SURSRVHGE0XNXQGDQHWDOWKH
DXWKRUVSURYLGHWZRPDLQSDUWVLQFOXGLQJ
D WRWDO RI FULWHULD 3DUW , *HQHUDO
DWWULEXWHV LQFOXGHV VXEVHFWLRQV 7KH
WH[WERRN DERXW VOODEXV DQG FXUULFXOXP
0HWKRGRORJ 6XLWDELOLW WR OHDUQHUV
3KVLFDO DQG XWLOLWDULDQ DWWULEXWHV
and Ecient outlay of supplementary
PDWHULDOV 3DUW ,, 7HDFKLQJOHDUQLQJ
FRQWHQW LQFOXGHV VXEVHFWLRQV *HQHUDO
/LVWHQLQJ 6SHDNLQJ 5HDGLQJ :ULWLQJ
9RFDEXODU*UDPPDU3URQXQFLDWLRQDQG
([HUFLVHV
,,,HWKRGRORJ
RQWHWRIWKHVWXG
3.1.1.An overview of the textbook
“ACTIVESkillsforReading4”
&7,9( 6NLOOV IRU 5HDGLQJ
ZULWWHQ LQ E 1HLO - QGHUVRQ D
UHDGLQJVSHFLDOLVWFRQVLVWVRIWKHPDWLFDOO
organized non-ction reading texts to
KHOS OHDUQHUV LPSURYH WKHLU UHDGLQJ
FRPSUHKHQVLRQDQGYRFDEXODUVNLOOV
The book introduces 12 dierent
UHDGLQJ WRSLFV ZLWK FRPPRQ H[HUFLVHV
WR KHOS OHDUQHUV LPSURYH WKHLU UHDGLQJ
DELOLWLQJHQHUDO(DFKWRSLFFOHDUOQRWHV
ZKDWDUHDVRIVNLOOVZLOOEHLPSURYHGDQG
SUHFLVHOKRZWKHLPSURYHUHDGLQJDELOLW
LQSUDFWLFH6RPHRIWKHEDVLFVLQFOXGH
‡%HIRUHRX5HDGEULHIRYHUYLHZ
RIWKHWRSLF
‡5HDGLQJ6NLOO6FDQQLQJ3UDFWLFH
VFDQQLQJ VNLOOV HDFK WRSLF ZLOO DSSO
dierentskills)
‡5HDGLQJ &RPSUHKHQVLRQ &KHFN
RXU8QGHUVWDQGLQJ7ZRH[HUFLVHVWRWHVW
UHDGLQJFRPSUHKHQVLRQ
‡&ULWLFDO7KLQNLQJ3UDFWLFHFULWLFDO
WKLQNLQJZLWKNQRZOHGJHDQGTXHVWLRQVLQ
WKHERRN
‡9RFDEXODU &RPSUHKHQVLRQ
:RUGV LQ FRQWH[W 5HDG DQG XQGHUVWDQG
vocabularyinspecicsituations.
SDUWIURPWKHPDLQXQLWVWKHUH
DUHUHYLHZXQLWVHDFKRIZKLFKFRQVLVWV
RI UHDGLQJ SDVVDJHV IRU VWXGHQWV WR
SUDFWLFHDQGLPSURYHWKHLUUHDGLQJVNLOOV
3.1.2. Overview of the course
ReadingSkillsLevel6
7KH 5HDGLQJ 6NLOOV PRGXOH LV
WDXJKWLQWKHQGVHPHVWHURIWKHWKLUGHDU
RI WKH FXUULFXOXP 7KH PRGXOH DLPV WR
KHOSOHDUQHUVKDYHUHDGLQJFRPSUHKHQVLRQ
VNLOOV LQ (QJOLVK HTXLYDOHQW WR OHYHO
DFFRUGLQJWRWKHOHYHO)RUHLJQ/DQJXDJH
&RPSHWHQF )UDPHZRUN IRU 9LHWQDP
RU HTXLYDOHQW WR OHYHO & DFFRUGLQJ WR
WKH (XURSHDQ )UDPHZRUN RI 5HIHUHQFH
&()5 7KH PRGXOH LQFOXGHV XQLWV
RI OHVVRQV ZLWKFRUH FRQWHQWWRIRUPDQG
GHYHORSUHDGLQJFRPSUHKHQVLRQVNLOOVIRU
VWXGHQWV
7KH FRXUVH OHDUQLQJ RXWFRPHV
&/2VDUHDVIROORZV
&/25HFRJQL]HWKHVWUXFWXUHRI
ORQJDQGFRPSOH[DFDGHPLFWH[WV
&/2 'HWHUPLQH WKH FRUUHFW
PHDQLQJ RI ZRUGV LQ ORQJ DQG FRPSOH[
DFDGHPLFWH[WV

- CLO3: Prociently applyreading
VNLOOVWRGHWHUPLQHWKHPHDQLQJRIWKHWH[W
3DWLFLSDQWV
7KH UHVHDUFK VXEMHFWVRI WKLVVWXG
DUHOHFWXUHUVDQGWKLUGHDUVWXGHQWV
DW WKH )DFXOW RI (QJOLVK DQRL 2SHQ
8QLYHUVLW 7KH DUH WKH RQHV ZKR KDYH
GLUHFWOXVHGWKHFWLYH6NLOOVIRU5HDGLQJ
WH[WERRNLQWKHSDVWVFKRROHDU
/HFWXUHUV 7KH WHDFKHUV
SDUWLFLSDWLQJLQWKHVWXGDUHDOOIXOOWLPH
OHFWXUHUVDWDQRL2SHQ8QLYHUVLW
RIZKRPKDYH0DVWHUVGHJUHHVDQGKDYH
PDQHDUVRIH[SHULHQFHWHDFKLQJDWWKH
XQLYHUVLW OHYHO DQG WHDFKLQJ 5HDGLQJ
VNLOOVRI(QJOLVK/DQJXDJHPDMRUV
6WXGHQWV 7KLV VWXG VXUYHHG
WKH RSLQLRQV RI WKLUGHDU VWXGHQWV
PDMRULQJ LQ (QJOLVK /DQJXDJH 7KH
studentshavemanydierentbackgrounds,
EXW DOO KDYH DQ (QJOLVK OHYHO HTXLYDOHQW
WR % RU KLJKHU DQG DOO KDYH XVHG WKH
FWLYH 6NLOOV IRU 5HDGLQJ WH[WERRNIRU
VHPHVWHUV
HWKRGVRIWKHVWXG
7KH DXWKRUV XVHGD PL[HGPHWKRGV
DSSURDFK LQ WKLV VWXG FRPELQLQJ
TXDQWLWDWLYH DQG TXDOLWDWLYH UHVHDUFK
PHWKRGV &UHVZHOO &ODUN
4XDQWLWDWLYH UHVHDUFK LV KHOSIXO IRU
VXPPDUL]LQJ ODUJH DPRXQWV RI GDWD
DQG DFKLHYLQJ JHQHUDOL]DWLRQV EDVHG RQ
VWDWLVWLFV %DEELH 2Q WKH RWKHU
KDQG D TXDOLWDWLYH DSSURDFK LV XVHG WR
JDWKHU LQGHSWK LQIRUPDWLRQ WR JDLQ D
EURDG XQGHUVWDQGLQJ RI WKH DVVHVVPHQW
DQG VXJJHVW LPSURYHPHQWV 7KH SUHVHQW
UHVHDUFK FROOHFWV TXDQWLWDWLYH GDWD
WKURXJKDVXUYHTXHVWLRQQDLUHLQFOXGLQJ
HYDOXDWLRQFULWHULDDQGTXDOLWDWLYHGDWDLV
REWDLQHGWKURXJKLQGHSWKLQWHUYLHZV
,QVWXPHQWVRIWKHVWXG
7KHUHDUHWZRLQVWUXPHQWVWRJDWKHU
GDWDIRUWKHSUHVHQWVWXG)LUVWWKHDXWKRU
XVHG D TXHVWLRQQDLUH WR HYDOXDWH WKH
HYDOXDWLRQ RI WKH SDUWLFLSDQWV WH[WERRN
VWXG7KHTXHVWLRQQDLUHKDVWZRTXHVWLRQV
PXOWLSOHFKRLFHDQGRSHQHQGHGTXHVWLRQV
onaLikertscale.Ave-pointLikertscale
ZDV XVHG ZKHUH UHVSRQVHV UDQJHG IURP
VWURQJO GLVDJUHH WR VWURQJO DJUHH
0RUHLPSRUWDQWOWKHQHFHVVDUGDWDZHUH
FROOHFWHG DERXW WKH FKDUDFWHULVWLFV RI WKH
ERRNVWKHWH[WERRNVHULHVDQGDGGLWLRQDO
FRPPHQWVIURPWHDFKHUVDERXWWKHFWLYH
6NLOOV IRU 5HDGLQJ WH[WERRN ,Q WKLV
VWXG WKH DXWKRUV UHOLHG RQ WKH OLVW RI
WH[WERRN HYDOXDWLRQ FKHFNOLVWV SURSRVHG
EWZRJURXSVRIUHVHDUFKHUV/LW]
DQG 0XNXQGDQ HW DO WR DGMXVW
DQGGHVLJQDOLVWRIHYDOXDWLRQFKHFNOLVWV
IRU WKH WHDFKLQJOHDUQLQJ FRQWHQW LQ WKH
WH[WERRNFWLYH6NLOOVIRU5HDGLQJ7KLV
FKHFNOLVW LQFOXGHV FULWHULD GLYLGHG
LQWR PDLQ SDUWV 7RSLF DQG FRQWHQW
5HDGLQJ VNLOOV 9RFDEXODU ([HUFLVHV
DQG WDVNV 7KH VHFRQG LQVWUXPHQW LV WKH
LQGHSWKLQWHUYLHZ7KHDXWKRUFRQGXFWHG
LQWHUYLHZV ZLWK WZR WHDFKHUV WR VHHN
WHDFKHUV RSLQLRQV RQ WKHWH[WERRN EDVHG
RQWKHLUH[SHULHQFHVLQXVLQJLWRUWRFODULI
DQPLVXQGHUVWDQGLQJVLIDQ
DWD FROOHFWLRQ DQG DQDOVLV
SRFHGXHV
7KH TXHVWLRQQDLUHV ZHUH GHOLYHUHG
WRWKHWHDFKHUVDQGVWXGHQWVRQOLQHWKURXJK
WKH *RRJOH )RUP DSSOLFDWLRQ 'LUHFWLRQV
ZHUH DOVR JLYHQ WR WKH SDUWLFLSDQWV
5HVSRQVHV ZHUH PDQXDOO HQWHUHG LQWR
computersoftware,specicallyMicrosoft
Oce Excel 2016,and processed tond
QXPEHUV DQG SHUFHQWDJHV 7KH VWDWLVWLFV
ZHUHSUHVHQWHGLQWDEOHVFRQVLVWLQJRIERWK
QXPEHUV DQG SHUFHQWDJHV %HVLGHV WZR