Learning The Science Behind Drug Addiction: A School-based . - ERIC

1y ago
23 Views
2 Downloads
704.35 KB
13 Pages
Last View : Today
Last Download : 3m ago
Upload by : Aiyana Dorn
Transcription

Learning the Science behind Drug Addiction: A School-basedLaboratory Approach to Addiction PreventionRhea MilesEast Carolina UniversityPatricia J. Slagter van TryonEast Carolina UniversityAbstractThe purpose of Science Education Against Drug Abuse Partnership (SEADAP) is to use the planarian animal modelto develop an inquiry-based program to teach the science of drug addiction and pharmacology of drugs being abused.Upon completion of a SEADAP teacher professional development, study data reveals a favorable increase in teacherawareness of careers related to biomedical research, knowledge of the hazards of using addictive substances, knowledge about the science of drug addiction and skills related to the use of animals in scientific research. Additionally,SEADAP supported professional development (PD) for teachers is of high quality, relevant to their needs, and meetstheir expectations in providing important resources for teaching and learning. SEADAP teacher participants gainrelevant knowledge about drug addiction and abuse to incorporate it into instruction about the scientific process.Teacher SEADAP participants administered a pretest to middle school students prior to SEADAP-related instructionand a posttest was administered to student participants after SEADAP-related instruction had concluded. Studentmean posttests scores on knowledge about drugs, biomedical careers and animal model research significantly increased from pretest scores. This indicates that the implemented lessons of the SEADAP teachers impact students.IntroductionIn 2011, the estimated cost of illicitdrug use to the United States (US) economy was 193 billion (National DrugIntelligence Center, 2011). Healthcarecosts associated with both alcohol andtobacco abuse was estimated at 150 billion per year. In addition to this strain onThe United States financial resources, themedical consequences of drug addictionhave been associated with furthering theprogression of brain disease (Aggarwal,Sian & Levine, 1998). Some of the resulting neurological medical issues associatedwith this disease include, stroke, seizures,paranoia, depression and aggression(National Institute on Drug Abuse, 2012).Persons addicted to any number of drugsmay also resort to crime including assault,burglary, identity theft and domestic violence, and these crimes cost the criminaljustice system over 61 billion dollars peryear (Mumola & Karberg, 2006; NationalDrug Intelligence Center, 2011).Drug addiction statistics reveal thatapproximately 7 billion has been spentin the United States on drug educationand prevention programs (Griffith &Scheier, 2013; Kim, Colleti, Crutchfiled, Williams & Hepler, 1995; Ruuska,2012). Currently, 6th-12th grade schooldrug abuse and prevention programssimply provide students with information about addiction and commonlyabused drugs. The purpose of programssuch as Define Assess Respond andEvaluate (DARE), Project Alert, Positive Action, and Keepin’ It Real, offerinformation and education to dissuadestudents from using drugs (Clayton,Leukfeld, Harrington, & Cattarello, 1996,Ennett et al., 1994; Hecht & Miller-Day,2010; Lewis et al., 2013; Lynam et al.,1999; Rand Corporation, 2016). Whilethe effect of these programs on curtailing drug use is continuously beingevaluated (Ringwalt et al., 2011), thesedrug abuse education programs providelimited, if any, information to studentsregarding the pharmacology of drugsbeing abused and even fewer promoteconducting responsible research withlive animals pointing to the effects ofdrug abuse.The effects of addictive substances havebeen traditionally studied using mammals(i.e., humans and rats) in research labssuch as pharmaceutical labs, governmentresearch agencies and medical facilities.The use of mammals in 6th -12th gradeclassrooms can be a challenge to maintain and a great expense (Departmentof Comparative Medicine: Animal CareHusbandry, 2014). Studies, however, dopoint to the use of simpler organismssuch as planaria to understand behaviorsassociated with drug abuse (Rawls, Patil,Yuvasheva, & Raffa, 2010).Science Education Against DrugAbuse Partnership ProgramTo overcome the impracticality ofexperimentation with mammals in theclassroom laboratory, the Science Education Against Drug Abuse Partnership(SEADAP) program incorporates theuse of planarians, also termed aquaticflatworms, as a less expensive but effective strategy to engage students in thestudy of drug addiction and abuse. Withinthe SEADAP program, teachers andKeywords: professional development, inquiry, drug abuse, drug addictionSPRING 2019 VOL. 27, NO. 133

students engage in lessons and strategieswhich involve the use of planarians thatmimic mammalian-like neuro-transmittersystems that are targeted by addictivesubstances. Teachers learn through experimental investigations on the pharmacological effects of drug abuse in planarians,which in turn supports their students inthe study of key facets of addiction whichinclude withdrawal, anxiety and placepreference conditioning, each of which arehighlighted within the educational materials developed by the SEADAP program.For full detailed lessons refer to nPlans.pdfGoalsThe purpose and broader impact ofthe SEADAP program is for students tolearn about drug addiction and the adverseaffects of widely abused drugs and conduct inquiry-based investigations usingplanaria. The proposed goals of SEADAPare to develop and implement an inquirybased program to teach the pharmacologyof drug addiction to students and to exposemiddle and high school students to drugaddiction research. The goals of the program during the first year were to increase:1) knowledge about the science of drugaddiction, 2) knowledge about biomedicalcareers, and 3) understanding about howanimal models are used to advance knowledge about medical research.Research QuestionsThis study addresses the followingresearch questions: 1) To what extentdid SEADAP provide high quality PDfor the participating teachers? and 2) Towhat extent did the participating teachersin SEADAP transfer the goals of the program to their own teaching and learningenvironments?Theoretical FrameworkAccording to Quigley (2014), bestteaching practices in science educationinclude student participation in investigative activities which go beyond traditional“cookbook” laboratory procedures. Likewise, Schneider, Krajcik and Blumfield(2005) point to professional development for science teachers in transforming science instruction from a “telling”34to a “doing” experience. These ideas areadvocated by the American Associationfor The Advancement of Science. AAAS(1993) and National Resource Council(2000) which both promote changinginstruction to optimize student learningof science to promote scientific literacy.While inquiry is not a new idea embedded in the Benchmarks for Science Literacy (AAAS, 1993), it remains critical toreform-based teaching in science education. Science education reform effortsinvolve incorporating inquiry-based instruction and have served to shift the focusof science instruction to include greaterstudent participation in the culture of thescientific community and immerse students in real-world experiences. Lave andWenger (1991) refer to this as a learningthat goes beyond acquisition of facts, butembeds the practice and problem solvingin the full social context of the learningevent taking place. This shift in focus fromrote memorization of scientific facts toprotocols designed to support the development of student understanding of scientific concepts and the inquiry process hasthe potential to motivate students towardfurther study in all fields of science.Additionally, greater learning outcomes are realized when students areafforded the opportunity to associatescience with solutions to real worldproblems which are relevant to themin meaningful ways (Huang, Chiu, &Hong, 2016). As students experiencethe culture of scientists and engagein practices that provide opportunitiesfor authentic learning, the academiclanguage of the scientists eventuallybecomes the language of the student.The student develops an understandingof and familiarity with science and canbegin to apply scientific principles outside the classroom.To further assist in the developmentof authentic learning environments forstudents, teachers should participate inhigh quality professional development(PD) that includes the best instructionalpractices aligned with state and nationalstandards to improve student education(Capps & Crawford, 2013; Geier et al.,2008; Lieberman & Wehlburg, 2002;Little, 1993; Talbert, McLaughlin, &Rowan, 1993). High quality PD can beinitially delivered in a few hours or dayshowever, in order to be meaningful andsustainable, it must be ongoing withfollow-up in the months that follow thePD (Wei, Darling-Hammond, Andre,Richardson, & Orphanos, 2009; Velardi,Folta, Richard & Kuehn, 2015). Further,high quality professional developmentsessions in science education should bedesigned to offer practical strategies thatwill later be incorporated into teachingand learning that is relevant to studentsand promotes exploration in to employment needs in science-related fields(Garret, Porter, Desimone, Birman & Yoon,2000; Lieberman & Wehlburg, 2002;Little, 1993; Talbert & McLaughlin, &Rowan, 1993). Moreover, high qualityPD should allow teachers to collaborateand discuss strategies to implement lessons for students to understand scientific concepts and processes through realworld experiences (Capps & Crawford,2013; Furtak, Seidel, Inverson, & Briggs,2012; Geier, et al., 2008; McComas &Jiang, 2015; Miles, Slagter van Tryon, &Moore Mensah, 2015). Therefore, highquality PD in science education that isdesigned and developed for hands-on,inquiry-based authentic learning affordsteachers the opportunity to participatein a type of embedded learning in whichtheir students will later engage. According to Tretter and Jones (2003), studentsengaged in inquiry-based lessons weremore likely to have higher attendance inschool, show up to take tests, and havea positive attitude about science. Archerand Ng (2016) reported that incorporating the scientific method and inquirybased strategies, even in the mathematicsclassroom, allowed students to make predictions and conclusions related to solving problems in real time.The management of the classroomlearning environment in science educationis also a key component of high qualityPD (Catalano, 2010; Roffey-Barentsen,2011) and is consistently consideredin the SEADAP program development.This includes methodologies to organizestudents to conduct inquiry-based activities in collaboration with trained teachersand assistants. High quality PD shouldSCIENCE EDUCATOR

also incorporate teacher familiarity withassigning student roles and responsibilities to complete group work, studentpairs, and whole class group learningtasks (Catalano, 2010; Hsiung, 2012).Careful selection of role assignments forstudent pairing and small group activitiespromotes successful collaboration byhaving students accountable for learning, developing team interactions, andenhancing negotiation during problemsolving events. Students working in pairsand groups have the opportunity to engagein continued interactions with peers, aswell as share written and oral reflection of their understanding of scientificconcepts and content. Additionally, theylearn to not rely solely on the instructorto facilitate the learning event (Catalano,2010; National Center, Quality Teaching and Learning, the Office of HeadStart, 2012).MethodsThe SEADAP research scientist andscience education researcher lead theSEADAP professional development (PD)session for participating teachers. Duringthe PD, teachers participated in demonstrations in inquiry-based, hands-on investigations to lead their own students in thedesign of experiments using planariansfor drug abuse studies. Participating teachers were provided with lessons that addressthe Next Generation Science Standards,National Science Education Standards,and Common Core Essential Standards. This PD introduced teachers tobiomedical research protocols, researchethics, planarian animal model, analysisof drug addiction research, and methodsof analysis of research. The PD consistedof a four-day teacher participant trainingduring the academic year and totaled32 contact-hours.Setting and Sample PopulationSEADAP Professional Developmentsessions were conducted at two majoruniversities in North Carolina (NC)and Pennsylvania (PA). The programwas designed as a four-year project forteachers and students. The current studyfocuses on outcomes for SEADAPprofessional development for teacherSPRING 2019 VOL. 27, NO. 1participants in NC during year one andthe resulting impact of the SEADAP program on participating teachers’ students.Research DesignTeachersTeacher participants were recruitedfrom two school districts in NC duringthe summer prior to the academic year inwhich they were to implement SEADAPlessons. Numerous strategies were usedto recruit participating teachers includingSEADAP staff appearance on a local newsshow and flyers advertising the programsent to targeted school districts, superintendents, principals, department chairs,and science teachers. Presentations weremade at conferences to motivate teacherparticipation, and written announcements were also posted in newslettersand professional development workshops sponsored by state and nationalscience education organizations. Scienceteachers were also telephoned and sentemails to motivate interest to participate in the SEADAP program. The PDincluded sessions led by key SEADAPstaff members, state-level politicians,STEM faculty at a university in NC, andlocal biomedical researchers. Teachers(n 10) were all instructors at the middleschool level and had an average of 10years teaching experience. The majority were female (n 9) with one maleparticipant. Seventy percent were Whiteand 30% Black. Teachers were paid astipend as an incentive to participate inSEADAP, as supported by Mclean andVan Wyk (2006).The research design included both qualitative and quantitative methodologies.One of the program evaluation instruments, the Professional DevelopmentQuestionnaire (PDQ), was developedand validated by the SERVE Center. TheSERVE Center is a regional educationalresearch and development organizationthat is well respected for evaluation ofSTEM and instructional technology projects. Questionnaire items were examinedby multiple parties (SERVE representatives and researchers) revised and editedthrough an iterative process to achieveface validity consensus that the itemswere appropriately stated for collectingdata to measure what the PDQ intended.The PDQ contained Likert scale typeitems based on data sought from teachers’ awareness of science-related careers(particularly biomedical careers); knowledge of the hazards of using addictivesubstances; knowledge about the scienceof drug addiction; skills related to the useof planarians in basic science research.The Cronbach’s alpha, a measure of theinternal consistency for the eight itemLikert statements on the PDQ, was 0.81.Formative data was collected on perceptions of whether the program was of highquality, relevant to teacher needs, provided important resources, and whetherthe program met expectations. The PDQalso included open-ended response itemsto gather data pertaining to the most andleast useful aspects of the SEADAP professional development.StudentsAll NC students were in grades 6-8from two public school districts andwere the students of the 10 SEADAPteacher participants. Of a total of 304participating students, approximately52% were female (n 158) and 48%(n 146) were male. Two percent (n 5)were American Indian /Alaska Native,1% (n 4) were Asian, 38% (n 114)were Black or African-American,10% (n 29) were Hispanic/Latino,34% (n 103) were White, and 15%(n 46) indicated multiple ethnicity/racegroup. Three students did not indicateethnicity/race.Pretests and PosttestsThe pretest and posttest instrumentswere developed by SEADAP researchersin collaboration with the SERVE Centerto assess student knowledge related tothe program goals. Pretests and posttestitems were examined by SERVE representatives, SEADAP researchers, andNC teacher participants of SEADAP toagain address face validity and to measure the extent the SEADAP programaccomplished the goals of the program.A pretest instrument was administeredto students of teacher participants priorto SEADAP-related instruction. Anidentical posttest was administered to35

student participants after SEADAPrelated instruction had concluded. Thepre/posttest instrument items addressedGoal 1 (items 1, 2, 3, 4, 5, 6, 7, 8 and9), Goal 2 (items 10 and 13) and Goal 3(items 11 and 12) - see Appendix C. Threehundred eighty-four students took thepre or posttests. Of these 384 students,304 completed both the pre and posttests which were explicitly matched foranalysis.ObservationsThe SERVE evaluators used an observation protocol designed specificallyfor the SEADAP program and observedat least one class period (which rangedfrom 50 to 90 minutes) in which studentsof teacher participants were conductingexperiments with planaria (i.e., stereotypy, motility, chronic drug exposure,and place conditioning). The observation protocol was designed by SERVEwith input from the SEADAP researchers. The observations were not intendedto judge nor rate teacher performances inany way, but instead to help identify challenges and/or successes that emerge asstudents increase their knowledge aboutbiomedical research and gain knowledgerelevant to conducting SEADAP-relatedexperiments in the classroom. To support further validity evidence, qualitativedata from the observation protocol washand coded (Patton, 2002) and analyzedusing the constant comparative method,an iterative process of coding qualitative data or recurring themes (Merriam,2001) by SEADAP researchers. Inter-raterreliability was present among SEADAPresearchers as achieved in reportingemergent themes from qualitative dataanalysis.in Table 1, responses were based on afive-point Likert scale (SA stronglyagree, A agree, N neutral, D disagree,and SD strongly disagree). Teachersreported (mean scores ranged from a lowof 4.30 to a high of 4.70) the PD sessionsincreased their awareness of sciencerelated careers (particularly biomedical careers), increased their knowledgeof the hazards of using addictive substances, increased their knowledge aboutthe science of drug addiction, increasedtheir skills related to the use of planarians in basic science research, were ofhigh quality, were relevant to their needs,provided important resources, and metexpectations.Teacher participants were also askedto respond to open-ended questions onthe PDQ about what were the most andleast useful parts of the PD. Based oncontent analysis of open-ended questionson the questionnaire, the following components were considered the most andleast useful parts of the PD opportunitiesprovided.Focus Group Sessions (FGS)Focus Group Sessions (FGS) were alsoconducted near completion of the PD toassess teacher perceptions of their learning experience. To decrease bias, FGSwere conducted by SERVE staff and notby the SEADAP researchers, with eachsession lasting for approximately 45minutes. Before implementation, FGSwere conducted face-to-face with teacherparticipants (n 10) near the completionof the PD.The after implementation FGS wereconducted via Google Hangout videoconference with teachers (n 6). Teachers were asked two questions: 1) whatwere the most successful aspects ofimplementation? and 2) what were themost challenging aspects of implementation? FGS were analyzed by SEADAPresearchers. Qualitative analyses wereconducted using a constant comparativemethod, an iterative process of codingqualitative data for recurring themes(Merriam, 2001). Researchers werecautious during the analysis process toreport emergent themes grounded indata (Patton, 2002).Most useful: Knowledge gained about drugaddiction and effects of addictivesubstances Availability of resources to assistwith implementation of SEADAPlessons Collaboration with other teachersto plan SEADAP-relatedinstruction Access to researchers and staff toanswer questions related to thedevelopment and implementationof lessons.ResultsTo address the research question: towhat extent did SEADAP provide highquality PD for the participating teachers? Teachers were asked to completethe PDQ regarding their professionaldevelopment experience at the conclusion of the workshop sessions. As seenTable 1. Professional Development Questionnaire (PDQ)1. Increased my awareness of STEM careers (particularly biomedical careers).2. Increased my knowledge of the hazards of using addictive substances.3. Increased my knowledge about the science of drug addiction.4. Increased my skills as they related to the use of planarians in basic science research.5. Was of high quality.6. Was relevant to my needs.7. Provided important resources for me.8. Met my n4.604.404.304.604.404.404.704.40SCIENCE EDUCATOR

Least useful: Skype and video lectures did nothave a human connection Some lunchtime speakers wereperceived as presenting irrelevantinformation Limited opportunities to do handson experiments Unavailability of pretest to guidelesson plan development Some of the content knowledgewas too in depth for studentsThe researchers and SERVE reconciled any inconsistencies. If any teacherresponse did not align to the questionthen responses were dropped.To address the research question:to what extent did the SEADAP participating teachers transfer the goals ofthe program to their own teaching andlearning environments? Paired samplet-tests were conducted to determine ifthere was a significant change for student pre and post test scores (see Tables2 and 3). Pretest and posttest scores forthe total number of student participants(N 304) comparison indicated that themean pretest score was 5.27(SD 2.13)and mean posttest score was 7.09(SD 2.99). A significant increase frompretest posttest was found (t (303) -10.939, p 0.001). Upon further analysis it is interesting to note that a pairedsample t-test was conducted and significant increases from pretest to posttestwere found for the students by teacher.For teacher 3 the mean pretest studentscore was 5.07 (SD 2.05) and meanposttest score was 11.06 (SD 1.50).A significant increase from pretest toposttest was found (t (53) -19.227,p 0.001). For teacher 7 the mean scoreof the pretest was 5.73 (SD 2.33),and the mean posttest score was 7.05(SD 2.92). A significant increasefrom pretest to posttest was found(t (61) -3.73, p 0.001). No significant differences were found for theremaining student scores by teachermean pretest and posttest scores. Therewere also no significant differences forthe students of the SEADAP teacher byethnicity or gender.SPRING 2019 VOL. 27, NO. 1Table 2. Paired Sample t test All ionsObservations of the teachers wereanalyzed and coded by the researchersand SERVE. Themes pertaining to challenges and successes emerged. The following challenges were perceived by theteacher participants for the students. Off task behavior Time to complete an experiment Unwilling to design their ownexperiment Planarians dying Unfamiliarity with the scientificmethod Mathematics calculationsTeacher participants were able to provide student instruction related to theSEADAP curricula in the classroom andwere observed successfully: Grouping (2-3 students) to complete laboratory investigations Implementing afterschool programwith small of group of students(fewer than 10) Incorporating the scientific method Providing written materials forstudents to read to implementlaboratories Writing laboratory proceduresprior to implementation Assisting students with conductinglaboratories by adult volunteersM7.09SD2.99t-10.939df303p0.000*Teachers faced challenges and successes during the implementation of theSEADAP curricula within their studentlearning environments. Timing allocation issues in conducting experimentsand familiarity with science and mathematics content/concepts were majorchallenges for students. However, assisting groups of students with the writingand implementation of the experimentswas observed as successful.Before Implementation Protocol:Near the completion of the PD all tenNC teachers were asked to discuss theirexperience before implementation ofSEADAP lessons with students. Constantcomparative method was used ( Merriam,2001), and seven themes emerged: 1)Relevancy of topic 2) Knowledge aboutthe topic 3) Comfort with implementation 4) Knowledge about scientific process 5) Student engagement 6) Issueswith implementation 7) Program focus.During Implementation Protocol: AllNC SEADAP teachers provided their students with instruction about the anatomy and movement of planaria. In allteacher classroom settings students wereobserved working in pairs or in groups.Teachers were required to implementtwo lessons which included the use ofplanaria and the substances caffeine,Table 3. Paired Sample t Test ge number .0060.0570.000*0.0090.0220.0010.000*37

alcohol, sucrose or nicotine. The lessoninvestigations were noted to incorporatestereotypy, motility, chronic drug exposure, anxiety, withdrawal, or place preference conditioning.Focus Group SessionAfter Implementation: During FocusGroup Session (FGS) via Google Hangout (n 6), teachers were asked todescribe their successes and challengesassociated with the implementation oftheir SEADAP curricula. The videosession was approximately 45 minutes.Various challenges were consistentlyreported and there were a few challenges discussed. Limited knowledgeabout using planarians in SEADAPexperiments were difficult for boththe teacher participants and their students. Snow days were an obstaclewhich delayed plans to use planariansin the classroom. Planarians would bedelivered to school and, as result ofschool cancellations due to inclement weather, upon return to schoolthe planarians would not be viable touse. Additionally, teachers commentedthat they did not know what to expectwhen facilitating laboratory investigations using planarians in prescribed drugenvironments. This uncertainty made theteachers feel uncomfortable, especiallywhen students would seek confirmationof results. One teacher said that one ofher three classes was unable to focuson SEADAP activities, and thereforedecided not to implement SEADAPinvestigations with that particular class.Finally, one teacher reported that implementing SEADAP lessons in a 50-minute period was a struggle and wouldstrongly recommend carrying out investigations with middle school studentsduring 90-minute block schedules.In spite of reported challenges, therewere several successes related to theimplementation of SEADAP lessons.One teacher incorporated the use of microscopes for the first time, and anotherinvited a guest speaker to the class toshare expertise about drug addiction. Inaddition, one teacher was able to connectSEADAP curricula to other health anddrug prevention programs occurring at38her school. Similarly, one teacher notedthat SEADAP instruction allowed students actually to see the effects of drugs,such as nicotine on planarians whichexpanded the experience beyond the “justsaying no” often found in existing drugprevention programs.DiscussionThis study reports preliminary findings addressing research questions forthe first year of the four-year SEADAPproject for middle school teachers andstudents. NC teachers responded favorably regarding their participation inSEADAP. Study data revealed that uponthe completion of the PD, a resultingincrease was reported in teacher awareness of careers related to biomedicalresearch, knowledge of the hazards ofusing addictive substances, knowledgeabout the science of drug addiction,and skills related to the use of planarians in scientific research was achieved.Teacher participants reported that thePD was of high quality, relevant to theirneeds, met expectations, and providedimportant resources. Data collected fromopen-ended questions mirrored FGS findings. Teachers gained relevant knowledge about drug addiction, the effects ofsubstance abuse and how to incorporatewhat they learned into the instruction ofthe scientific process.Drug prevention programs assist withlearning emotional and developmentalskills to engage in social environments,to lessen risk-taking behaviors associatedwith drug abuse, to debunk misinformation about drug addiction or abuse andto provide information about drugs currently being abused (Olsson & Fritzell,2015). The underlining resolve of teacherparticipation in SEADAP is to deterstudent use of illicit drugs which, haveadverse health effects, and to lower criminal activity (Mumola & Karberg, 2006;National Drug Intelligence Center, 2011;National Institute on Drug Abuse, 2012).Examining a change in student attitudes,possibly via reflective journals, aboutthe consequences of drugs of abuse isalso a focus of the SEADAP programand will continue in future study. Current research advocates having studentsengage in meaningful activities in programs like SEADAP which link scienceto aspects of health risks associatedwith illegal drug use as a key componentin education (Grace, Woods-Townsend,Griffiths, Godfrey, Hanson, Galloway,Inskip, 2012). The hope is to promoteinformed decision making for healthychoices when presented with situationswhere potentially addictive drugs arewithin a student’s reach.Future work and conclusionWhile a number of studies

of drug addiction to students and to expose middle and high school students to drug addiction research. The goals of the pro-gram during the fi rst year were to increase: 1) knowledge about the science of drug addiction, 2) knowledge about biomedical careers, and 3) understanding about how animal models are used to advance knowl-

Related Documents:

May 02, 2018 · D. Program Evaluation ͟The organization has provided a description of the framework for how each program will be evaluated. The framework should include all the elements below: ͟The evaluation methods are cost-effective for the organization ͟Quantitative and qualitative data is being collected (at Basics tier, data collection must have begun)

Silat is a combative art of self-defense and survival rooted from Matay archipelago. It was traced at thé early of Langkasuka Kingdom (2nd century CE) till thé reign of Melaka (Malaysia) Sultanate era (13th century). Silat has now evolved to become part of social culture and tradition with thé appearance of a fine physical and spiritual .

On an exceptional basis, Member States may request UNESCO to provide thé candidates with access to thé platform so they can complète thé form by themselves. Thèse requests must be addressed to esd rize unesco. or by 15 A ril 2021 UNESCO will provide thé nomineewith accessto thé platform via their émail address.

̶The leading indicator of employee engagement is based on the quality of the relationship between employee and supervisor Empower your managers! ̶Help them understand the impact on the organization ̶Share important changes, plan options, tasks, and deadlines ̶Provide key messages and talking points ̶Prepare them to answer employee questions

Dr. Sunita Bharatwal** Dr. Pawan Garga*** Abstract Customer satisfaction is derived from thè functionalities and values, a product or Service can provide. The current study aims to segregate thè dimensions of ordine Service quality and gather insights on its impact on web shopping. The trends of purchases have

Chính Văn.- Còn đức Thế tôn thì tuệ giác cực kỳ trong sạch 8: hiện hành bất nhị 9, đạt đến vô tướng 10, đứng vào chỗ đứng của các đức Thế tôn 11, thể hiện tính bình đẳng của các Ngài, đến chỗ không còn chướng ngại 12, giáo pháp không thể khuynh đảo, tâm thức không bị cản trở, cái được

Le genou de Lucy. Odile Jacob. 1999. Coppens Y. Pré-textes. L’homme préhistorique en morceaux. Eds Odile Jacob. 2011. Costentin J., Delaveau P. Café, thé, chocolat, les bons effets sur le cerveau et pour le corps. Editions Odile Jacob. 2010. Crawford M., Marsh D. The driving force : food in human evolution and the future.

Le genou de Lucy. Odile Jacob. 1999. Coppens Y. Pré-textes. L’homme préhistorique en morceaux. Eds Odile Jacob. 2011. Costentin J., Delaveau P. Café, thé, chocolat, les bons effets sur le cerveau et pour le corps. Editions Odile Jacob. 2010. 3 Crawford M., Marsh D. The driving force : food in human evolution and the future.