
1(/,212)((&,1/(51,1
&21(16,1((%22.&,(6.,//6
)255(,1)52(3(563(&,(62)
/(&5(5616(16()&/2)
(1/,612,23(11,(56,
DQDQKXDW
XLHXKX
(PDLOWKXDWWYKRXHGXYQ
5HFHLYHG
5HYLVHG
FFHSWHG
'2,KRXMV
EVWDFWThisstudywasconductedtondouttheopinionsoflecturersandstudents
abouttheteaching-learningcontentsinthetextbook“ActiveSkillsforReading4usedtoteach
ReadingSkillslevel6tothird-yearstudentsmajoringinEnglishatHanoiOpenUniversity.
Theauthorusedamixedresearchmethod,combiningquantitativeandqualitativeresearch
methodstoanalyzedata.ThelistoftextbookevaluationchecklistscompiledbyLitz(2005)
andtheauthorsMukundan,Nimehchisalem,andHajimohammadi(2011),afterbeingedited
tosuittheresearchobject,isusedasthemainresearchtool.Eightlecturersandeighty-four
third-yearstudentsmajoringinEnglishatHanoiOpenUniversityparticipatedinthestudy,
andtwoteacherswereinvitedtoparticipateininterviewstoclarifysomeinformation.Thedata
collectedrevealedthatmostsurveyedlecturersandstudentshighlyappreciatedthediversityof
topics,theirinterestinreadingcomprehension,andtheclarityofinstructionsfortheexercises
inthetextbookActiveSkillsforReading4.However,thecriteriaforthediversityofquestion
types,quantityandvarietyofvocabulary,andwayofintroducingvocabularyarenothighly
appreciated.Based on thendings, the interviewed lecturers madesome recommendations
onhowtousethistextbookmoreeectively.Thestudyhashelpfultheoreticalandpractical
contributionstotextbookselection,evaluation,andeectiveuseoftextbooks.
.HRGV:textbookevaluation,exercises,tasks,Activeskillsforreading4,courselearning
outcomes.
DQRL2SHQ8QLYHUVLW
,,WURGXFWLR
7KHUH DUH PDQ IDFWRUV WKDW OHDG
WR VXFFHVVIXO (QJOLVK OHDUQLQJ DQG
FKRRVLQJ WKH ULJKW WH[WERRN LV YHU
LPSRUWDQWFFRUGLQJ WR 0LHNOH 
D WH[WERRN SURYLGHV OHDUQHUV ZLWK D
VVWHPDWLF IRFXVHG SODQQHG FXUULFXOXP
DQG VWDQGDUGL]HG NQRZOHGJH FRQWHQW

FFRUGLQJO KRXU DQG KPDGL 
DOVRDVVHUW7H[WERRNVDUHWKHPDLQVRXUFH
WKDWFDQLPSDUWNQRZOHGJHDQGLQIRUPDWLRQ
WR OHDUQHUV LQ DQ HDV DQG RUJDQL]HG
PDQQHU 7KHUHIRUH WKH HYDOXDWLRQ RI
WKH WH[WERRN LV DQ LQGLVSHQVDEOH VWHS
7KH TXHVWLRQ LV KRZ LW FDQ EH DVVHVVHG
ZKHWKHU WKH WH[WERRN LV VXLWDEOH IRU WKH
REMHFWLYHVRIDFRXUVHDVZHOODVZKHWKHU
WKH WH[WERRN LV DSSURSULDWH WR WKH QHHGV
DQGUHTXLUHPHQWVRIWKHFRXUVHDQGOHYHO
RIOHDUQHUVRUQRW
7KH WH[WERRN Active Skills for
Reading 4 SXEOLVKHG E &HQJDJH
/HDUQLQJLQhasbeenociallyput
LQWRXVHDWWKH)DFXOWRI(QJOLVKDQRL
2SHQ 8QLYHUVLW IRU 5HDGLQJ  DQG 
VXEMHFWVIRUUGHDUVWXGHQWVIRUVHYHUDO
HDUV RZHYHU VR IDU QR UHVHDUFK KDV
EHHQ FRQGXFWHGWR HYDOXDWHWKH WHDFKLQJ
OHDUQLQJ FRQWHQW LQ WKLV WH[WERRN 7R
DGGUHVVWKLVLVVXHWKHUHLVDQXUJHQWQHHG
WR FRQGXFW DQ HYDOXDWLRQ RI WKH WH[WERRN
WR GHWHUPLQH LWV VXLWDELOLW WR WKH FRXUVH
OHDUQLQJ RXWFRPHV RI WKH 5HDGLQJ 
PRGXOHIRU(QJOLVKPDMRUVDWDQRL2SHQ
8QLYHUVLWLQRUGHUWRSURYLGHVXJJHVWLRQV
IRUEHWWHUXVHDVKPDGLDQG'HUDNKVKDQ
DVVHUWHGWKDWHYDOXDWLQJWH[WERRNV
helps teachers nd suitable textbooks
DQG DOORZV WKHP WR PDNH DGMXVWPHQWV
DQGPRGLIWKHVHERRNVWRPHHWVWXGHQWV
QHHGV
)RU WKH DERYH UHDVRQV WKH DXWKRUV
GHFLGHGWRFDUURXWWKHUHVHDUFKHQWLWOHG
Q HYDOXDWLRQ RI WKH WHDFKLQJOHDUQLQJ
FRQWHQWVLQWKHWH[WERRNFWLYH6NLOOVIRU
5HDGLQJIURPWKHSHUVSHFWLYHRIOHFWXUHUV
DQGVWXGHQWVDW)DFXOWRI(QJOLVKDQRL
2SHQ8QLYHUVLW7KLVUHVHDUFKDLPVWR
D (YDOXDWH WKH WHDFKLQJOHDUQLQJ
FRQWHQWV LQ WKH WH[WERRN FWLYH 6NLOOV
IRU 5HDGLQJ  IURP WKH SHUVSHFWLYH RI
OHFWXUHUV DQG VWXGHQWV DW WKH )DFXOW RI
(QJOLVKDQRL2SHQ8QLYHUVLW
E6XJJHVWZDVWRXVHWKHWH[WERRN
WRVXLWVWXGHQWVQHHGVDQGPHHWWKHFRXUVH
OHDUQLQJRXWFRPHV
7R DFKLHYH WKRVH JRDOV WKH DXWKRU
SURSRVHV WZR UHVHDUFK TXHVWLRQV DV
IROORZV
 7R ZKDW H[WHQW GR WKH WHDFKLQJ
OHDUQLQJ FRQWHQWV LQWKHFWLYH 6NLOOVIRU
5HDGLQJ IRXU WH[WERRN VDWLVI VWXGHQWV
QHHGV DQG PHHW WKH FRXUVH OHDUQLQJ
RXWFRPHV
 RZ VKRXOG OHFWXUHUV XVH 
Active Skills for Reading 4 WH[WERRN
WR PHHW VWXGHQWV QHHGV DQG WKH FRXUVH
OHDUQLQJRXWFRPHV
,,/LWHUDWXUHUHYLH
 2YHUYLH RI WHWERRN
HYDOXDWLR
2.1.1.Denition
Dierent authors have dierent
YLHZV RI HGXFDWLRQDO HYDOXDWLRQ 7KH
most extended denition of evaluation
KDV SUREDEO EHHQ SURSRVHG E %HHE
ZKRGHVFULEHGHYDOXDWLRQDVWKH
VVWHPDWLFFROOHFWLRQDQGLQWHUSUHWDWLRQRI
HYLGHQFH OHDGLQJDVD SDUW RIWKHSURFHVV
GR D MXGJPHQW RI YDOXH ZLWK D YLHZ WR
DFWLRQ
,Q 7RPOLQVRQV RSLQLRQ 
PDWHULDO HYDOXDWLRQ UHIHUV WR DWWHPSWV
WR PHDVXUH WKH YDOXH RI PDWHULDOV
7RPOLQVRQ  DOVR VWDWHV WKDW
PDWHULDO HYDOXDWLRQ LV D SURFHGXUH WKDW
LQYROYHV PHDVXULQJ WKH YDOXH RI D VHW
RI OHDUQLQJ PDWHULDO ,Q FRQFOXVLRQ
WH[WERRN HYDOXDWLRQ LV WKH DVVHVVPHQW RI
the suitability of the textbookto specic
UHTXLUHPHQWV LQFOXGLQJ OHDUQHU JRDOV
OHDUQHUFRQWH[WDYDLODEOHUHVRXUFHVHWF

2.1.2. The role of evaluating
teachingmaterials
0DQ PDWHULDOV DUH XVHG WR VXSSRUW
(QJOLVK WHDFKLQJ DQG OHDUQLQJ DFWLYLWLHV
FFRUGLQJWR7RPOLQVRQSS
WH[WERRNV ZRUNERRNV FDVVHWWH WDSHV &'
520VYLGHRVFRSLHVUHSRUWVRUSDVVDJHV
DQGDQWKLQJWKDWUHSUHVHQWVRULQIRUPVDERXW
ODQJXDJH OHDUQHG DUH FRQVLGHUHG WHDFKLQJ
PDWHULDOV RZHYHU LW LV XQUHDVRQDEOH WR
VDWKDWDQGRFXPHQWLVLQYDOLGXQUHOLDEOH
LPSUDFWLFDO DQG XQFOHDU 7KHUHIRUH
HYDOXDWLQJ WHDFKLQJ PDWHULDOV SODV DQ
LPSRUWDQW UROH LQ WKH ODQJXDJH WHDFKLQJ
SURFHVVKPDGHWDO%UDQFK
&XQQLQJVZRUWK  6DE]DOLSRXU 
.RRVKD6RRUL-DVPKLGL
,QVWUXFWLRQDO PDWHULDOV QHHG WR EH
FDUHIXOO HYDOXDWHG IRU WKH SXUSRVH RI
GHWHUPLQLQJ WKH UHVXOWV RI WKH WHDFKLQJ
SURFHVV,PSRUWDQWOWH[WERRNHYDOXDWLRQ
VKRXOGEHEDVHGRQFULWHULDDQGSURFHVVHV
)RU H[DPSOH %UDQFK  PHQWLRQV
LGHQWLILQJ DVVHVVPHQW VWDQGDUGV
VHOHFWLQJDVVHVVPHQWWRROVHJFKHFNOLVWV
&XQQLQJVZRUWK  0LHNOH 
0XNXQGDQ HW DO  DQG FRQGXFWLQJ
WKH DVVHVVPHQW &XQQLQJVZRUWK 
S  DGGV WKDW HYDOXDWLQJ ODQJXDJH
WHDFKLQJ PDWHULDOV WKRURXJKO LV WR
PHHW WKH OHDUQLQJ QHHGV RI OHDUQHUV WKH
UHTXLUHPHQWV RI WKH FXUULFXOXP DQG WKH
WHDFKLQJPHWKRGVDQGOLQJXLVWLFDVSHFWV
2.1.3. Methods of textbook
evaluation
7KH UHVHDUFKHUV GHYLVHG WKH VWDJHV
RIWH[WERRNHYDOXDWLRQ
FFRUGLQJ WR &XQQLQJVZRUWK
 WH[WERRN HYDOXDWLRQ KDV WKUHH
VWDJHV SUHXVH LQXVH DQG SRVWXVH
HYDOXDWLRQ
3HXVH HYDOXDWLRQ FFRUGLQJ
WR 7RPOLQVRQ  WKLV LV XVXDOO
FRQGXFWHG EHIRUH D WH[WERRN LV XVHG WR
SUHGLFW WKH YDOXH RI D WH[WERRN WR XVHUV
WR KHOS WKHP FKRRVH WKH ULJKW FRXUVH IRU
WKHFRXUVHDQGSXWLWWRXVHLQDSDUWLFXODU
FODVVURRP7KHSUHXVHDVVHVVPHQWVHHPV
themostdicultbecausethereisnoreal
H[SHULHQFHXVLQJWKHWH[WERRN
,QXVH HYDOXDWLRQ DQ evaluation
RI WKH VXLWDELOLW RI WKH FXUULFXOXP LQ
terms of specic requirements,including
OHDUQHUJRDOVOHDUQHUVFRQWH[WDYDLODEOH
UHVRXUFHVHWF&XQQLQJVZRUWK
3RVWXVHHYDOXDWLRQLVDQevaluation
RI WKH VXLWDELOLW RI D WH[WERRN RYHU D
SHULRG RI FRQWLQXRXV XVH FFRUGLQJ WR
7RPOLQVRQWKLVWSHRIDVVHVVPHQW
FDQ EH WKH PRVW YDOXDEOH EHFDXVH LW FDQ
measure theactual eect ofthetextbook
RQ XVHUV (YDOXDWRUV FDQ PDNH UHOLDEOH
GHFLVLRQVDERXWWH[WERRNXVHDGDSWDWLRQ
RUUHSODFHPHQWEDVHGRQPHDVXUHGGDWD
7KH DERYH H[SODQDWLRQV RI WKH
UHVHDUFKHUV VXJJHVW WKDW WKH HYDOXDWLRQ RI
documents can be done exibly as long as
QHFHVVDU RZHYHU SRVWXVH DVVHVVPHQW
yields better results because it fullyreects
FRJQLWLRQ&XQQLQJVZRUWK7KDWLVDOVR
WKHUHDVRQZKZHDSSOWKLVIRUPWRHYDOXDWH
WKHWH[WERRNFWLYH6NLOOVIRU5HDGLQJ
QXPEHU RI UHVHDUFKHUV KDYH
SURSRVHG ZDV WR GHYHORS D UHOLDEOH
IUDPHZRUN IRU PDWHULDOV HYDOXDWLRQ
6RPHRIWKHPRVWSRSXODURQHVDUHWKRVH
VXJJHVWHG E XWFKLQVRQ DQG :DWHUV
 /LWWOHMRKQ  0F 'RQRXJK
DQG6KDZ&XQQLQJVZRUWK
(OOLV  /LW]  DQG 0XNXQGDQ
HW DO ,Q WKLV VWXG EDVHG RQ WKH
OLVW RI WH[WERRN HYDOXDWLRQ FULWHULD RI
/LW]  DQG 0XNXQGDQ HW DO 
WKH DXWKRU PDGH VRPH DGMXVWPHQWV WR
VXLW WKH UHDOLW RI WHDFKLQJ DQG OHDUQLQJ
SUDFWLFHVDWWKH)DFXOWRI(QJOLVKDQRL

2SHQ8QLYHUVLWZKHUHWKHUHVHDUFKZDV
FRQGXFWHG
,Q /LW]V  OLVW RI WH[WERRN
HYDOXDWLRQFULWHULDWKHUHDUHDWRWDORI
criteria divided into dierent sections:
3UDFWLFDO &RQVLGHUDWLRQV /DRXW DQG
'HVLJQFWLYLWLHV6NLOOV/DQJXDJH7SH
7RSLFDQG&RQWHQWDQG&RQFOXVLRQ(DFK
FULWHULRQLVHYDOXDWHGRQDOHYHOVFDOHLQ
ZKLFKOHYHOHTXDWHVWRGLVDJUHHVWURQJO
DQGOHYHOHTXDWHVWRDJUHHKLJKO:LWK
WKH OLVW RIWH[WERRN HYDOXDWLRQFKHFNOLVWV
SURSRVHGE0XNXQGDQHWDOWKH
DXWKRUVSURYLGHWZRPDLQSDUWVLQFOXGLQJ
D WRWDO RI  FULWHULD 3DUW , *HQHUDO
DWWULEXWHV LQFOXGHV  VXEVHFWLRQV 7KH
WH[WERRN DERXW VOODEXV DQG FXUULFXOXP
0HWKRGRORJ 6XLWDELOLW WR OHDUQHUV
3KVLFDO DQG XWLOLWDULDQ DWWULEXWHV
and Ecient outlay of supplementary
PDWHULDOV 3DUW ,, 7HDFKLQJOHDUQLQJ
FRQWHQW LQFOXGHV  VXEVHFWLRQV *HQHUDO
/LVWHQLQJ 6SHDNLQJ 5HDGLQJ :ULWLQJ
9RFDEXODU*UDPPDU3URQXQFLDWLRQDQG
([HUFLVHV
,,,HWKRGRORJ
RQWHWRIWKHVWXG
3.1.1.An overview of the textbook
“ACTIVESkillsforReading4”
&7,9( 6NLOOV IRU 5HDGLQJ
ZULWWHQ LQ  E 1HLO - QGHUVRQ D
UHDGLQJVSHFLDOLVWFRQVLVWVRIWKHPDWLFDOO
organized non-ction reading texts to
KHOS OHDUQHUV LPSURYH WKHLU UHDGLQJ
FRPSUHKHQVLRQDQGYRFDEXODUVNLOOV
The book introduces 12 dierent
UHDGLQJ WRSLFV ZLWK FRPPRQ H[HUFLVHV
WR KHOS OHDUQHUV LPSURYH WKHLU UHDGLQJ
DELOLWLQJHQHUDO(DFKWRSLFFOHDUOQRWHV
ZKDWDUHDVRIVNLOOVZLOOEHLPSURYHGDQG
SUHFLVHOKRZWKHLPSURYHUHDGLQJDELOLW
LQSUDFWLFH6RPHRIWKHEDVLFVLQFOXGH
‡%HIRUHRX5HDGEULHIRYHUYLHZ
RIWKHWRSLF
‡5HDGLQJ6NLOO6FDQQLQJ3UDFWLFH
VFDQQLQJ VNLOOV HDFK WRSLF ZLOO DSSO
dierentskills)
‡5HDGLQJ &RPSUHKHQVLRQ  &KHFN
RXU8QGHUVWDQGLQJ7ZRH[HUFLVHVWRWHVW
UHDGLQJFRPSUHKHQVLRQ
‡&ULWLFDO7KLQNLQJ3UDFWLFHFULWLFDO
WKLQNLQJZLWKNQRZOHGJHDQGTXHVWLRQVLQ
WKHERRN
‡9RFDEXODU &RPSUHKHQVLRQ 
:RUGV LQ FRQWH[W 5HDG DQG XQGHUVWDQG
vocabularyinspecicsituations.
SDUWIURPWKHPDLQXQLWVWKHUH
DUHUHYLHZXQLWVHDFKRIZKLFKFRQVLVWV
RI  UHDGLQJ SDVVDJHV IRU VWXGHQWV WR
SUDFWLFHDQGLPSURYHWKHLUUHDGLQJVNLOOV
3.1.2. Overview of the course
ReadingSkillsLevel6
7KH 5HDGLQJ 6NLOOV  PRGXOH LV
WDXJKWLQWKHQGVHPHVWHURIWKHWKLUGHDU
RI WKH FXUULFXOXP 7KH PRGXOH DLPV WR
KHOSOHDUQHUVKDYHUHDGLQJFRPSUHKHQVLRQ
VNLOOV LQ (QJOLVK HTXLYDOHQW WR OHYHO 
DFFRUGLQJWRWKHOHYHO)RUHLJQ/DQJXDJH
&RPSHWHQF )UDPHZRUN IRU 9LHWQDP
RU HTXLYDOHQW WR OHYHO & DFFRUGLQJ WR
WKH (XURSHDQ )UDPHZRUN RI 5HIHUHQFH
&()5 7KH PRGXOH LQFOXGHV  XQLWV
RI OHVVRQV ZLWKFRUH FRQWHQWWRIRUPDQG
GHYHORSUHDGLQJFRPSUHKHQVLRQVNLOOVIRU
VWXGHQWV
7KH FRXUVH OHDUQLQJ RXWFRPHV
&/2VDUHDVIROORZV
&/25HFRJQL]HWKHVWUXFWXUHRI
ORQJDQGFRPSOH[DFDGHPLFWH[WV
 &/2 'HWHUPLQH WKH FRUUHFW
PHDQLQJ RI ZRUGV LQ ORQJ DQG FRPSOH[
DFDGHPLFWH[WV

- CLO3: Prociently applyreading
VNLOOVWRGHWHUPLQHWKHPHDQLQJRIWKHWH[W
3DWLFLSDQWV
7KH UHVHDUFK VXEMHFWVRI WKLVVWXG
DUHOHFWXUHUVDQGWKLUGHDUVWXGHQWV
DW WKH )DFXOW RI (QJOLVK DQRL 2SHQ
8QLYHUVLW 7KH DUH WKH RQHV ZKR KDYH
GLUHFWOXVHGWKHFWLYH6NLOOVIRU5HDGLQJ
WH[WERRNLQWKHSDVWVFKRROHDU
/HFWXUHUV 7KH  WHDFKHUV
SDUWLFLSDWLQJLQWKHVWXGDUHDOOIXOOWLPH
OHFWXUHUVDWDQRL2SHQ8QLYHUVLW
RIZKRPKDYH0DVWHUVGHJUHHVDQGKDYH
PDQHDUVRIH[SHULHQFHWHDFKLQJDWWKH
XQLYHUVLW OHYHO DQG WHDFKLQJ 5HDGLQJ
VNLOOVRI(QJOLVK/DQJXDJHPDMRUV
6WXGHQWV 7KLV VWXG VXUYHHG
WKH RSLQLRQV RI  WKLUGHDU VWXGHQWV
PDMRULQJ LQ (QJOLVK /DQJXDJH 7KH
studentshavemanydierentbackgrounds,
EXW DOO KDYH DQ (QJOLVK OHYHO HTXLYDOHQW
WR % RU KLJKHU DQG DOO KDYH XVHG WKH
FWLYH 6NLOOV IRU 5HDGLQJ  WH[WERRNIRU
VHPHVWHUV
HWKRGVRIWKHVWXG
7KH DXWKRUV XVHGD PL[HGPHWKRGV
DSSURDFK LQ WKLV VWXG FRPELQLQJ
TXDQWLWDWLYH DQG TXDOLWDWLYH UHVHDUFK
PHWKRGV &UHVZHOO  &ODUN 
4XDQWLWDWLYH UHVHDUFK LV KHOSIXO IRU
VXPPDUL]LQJ ODUJH DPRXQWV RI GDWD
DQG DFKLHYLQJ JHQHUDOL]DWLRQV EDVHG RQ
VWDWLVWLFV %DEELH  2Q WKH RWKHU
KDQG D TXDOLWDWLYH DSSURDFK LV XVHG WR
JDWKHU LQGHSWK LQIRUPDWLRQ WR JDLQ D
EURDG XQGHUVWDQGLQJ RI WKH DVVHVVPHQW
DQG VXJJHVW LPSURYHPHQWV 7KH SUHVHQW
UHVHDUFK FROOHFWV TXDQWLWDWLYH GDWD
WKURXJKDVXUYHTXHVWLRQQDLUHLQFOXGLQJ
HYDOXDWLRQFULWHULDDQGTXDOLWDWLYHGDWDLV
REWDLQHGWKURXJKLQGHSWKLQWHUYLHZV
,QVWXPHQWVRIWKHVWXG
7KHUHDUHWZRLQVWUXPHQWVWRJDWKHU
GDWDIRUWKHSUHVHQWVWXG)LUVWWKHDXWKRU
XVHG D TXHVWLRQQDLUH WR HYDOXDWH WKH
HYDOXDWLRQ RI WKH SDUWLFLSDQWV WH[WERRN
VWXG7KHTXHVWLRQQDLUHKDVWZRTXHVWLRQV
PXOWLSOHFKRLFHDQGRSHQHQGHGTXHVWLRQV
onaLikertscale.Ave-pointLikertscale
ZDV XVHG ZKHUH UHVSRQVHV UDQJHG IURP
VWURQJO GLVDJUHH WR VWURQJO DJUHH
0RUHLPSRUWDQWOWKHQHFHVVDUGDWDZHUH
FROOHFWHG DERXW WKH FKDUDFWHULVWLFV RI WKH
ERRNVWKHWH[WERRNVHULHVDQGDGGLWLRQDO
FRPPHQWVIURPWHDFKHUVDERXWWKHFWLYH
6NLOOV IRU 5HDGLQJ  WH[WERRN ,Q WKLV
VWXG WKH DXWKRUV UHOLHG RQ WKH OLVW RI
WH[WERRN HYDOXDWLRQ FKHFNOLVWV SURSRVHG
EWZRJURXSVRIUHVHDUFKHUV/LW]
DQG 0XNXQGDQ HW DO  WR DGMXVW
DQGGHVLJQDOLVWRIHYDOXDWLRQFKHFNOLVWV
IRU WKH WHDFKLQJOHDUQLQJ FRQWHQW LQ WKH
WH[WERRNFWLYH6NLOOVIRU5HDGLQJ7KLV
FKHFNOLVW LQFOXGHV  FULWHULD GLYLGHG
LQWR  PDLQ SDUWV 7RSLF DQG FRQWHQW
5HDGLQJ VNLOOV 9RFDEXODU ([HUFLVHV
DQG WDVNV 7KH VHFRQG LQVWUXPHQW LV WKH
LQGHSWKLQWHUYLHZ7KHDXWKRUFRQGXFWHG
LQWHUYLHZV ZLWK WZR WHDFKHUV WR VHHN
WHDFKHUV RSLQLRQV RQ WKHWH[WERRN EDVHG
RQWKHLUH[SHULHQFHVLQXVLQJLWRUWRFODULI
DQPLVXQGHUVWDQGLQJVLIDQ
 DWD FROOHFWLRQ DQG DQDOVLV
SRFHGXHV
7KH TXHVWLRQQDLUHV ZHUH GHOLYHUHG
WRWKHWHDFKHUVDQGVWXGHQWVRQOLQHWKURXJK
WKH *RRJOH )RUP DSSOLFDWLRQ 'LUHFWLRQV
ZHUH DOVR JLYHQ WR WKH SDUWLFLSDQWV
5HVSRQVHV ZHUH PDQXDOO HQWHUHG LQWR
computersoftware,specicallyMicrosoft
Oce Excel 2016,and processed tond
QXPEHUV DQG SHUFHQWDJHV 7KH VWDWLVWLFV
ZHUHSUHVHQWHGLQWDEOHVFRQVLVWLQJRIERWK
QXPEHUV DQG SHUFHQWDJHV %HVLGHV WZR