ORIGINAL ARTICLE

Pro-social and antisocial values in physical education. The validity and reliability of fair play questionnaire in physical education (FPQ-PE) into Albanian language

Abstract

Introduction:

Fair Play behaviours are moral and social behaviours that can be acquire from students throughout PE class. The main aim of this study was to translate and validate into Albanian language the questionnaire that measures and evaluate pro-social and antisocial behaviours in PE class.

Material and methods:

The process of validity was based in three steps: 1) Translation and Back Translation - the questionnaire was translated from experts of the field who were proficient in English language, and the process of back translation was done from experts of Albanian and English language. 2) Factor Analysis - 597 middle school students from Tirana, Albania, were involved, from which a simple size of 280 students (mean age=13.22±1.22 yr) was used to perform the EFA, and reliability, reporting the CA coefficient. For the CFA a sample size of 317 students (mean age=14.32±7.3 yr) was used. 3) Test-Retest Validity- the questionnaire was submitted to the same students as EFA in two times with an interval of 3 weeks between them.

Results:

Regarding Factor Analysis the KMO> than 0.5 and Bartlett's Test < 0.01 (KMO-0.820, χ2=1153.330; p=0.000), have indicated that the EFA could be performed. EFA has revealed that there were four factors, two for pro-social and two for antisocial. The CA coefficient for the four factors was: respect conventions (α=0.683), respect towards teammates (α=0.616), cheating (α=0.765) and gamesmanship (α=0.742). The CFA has indicated a good model fit (χ2=196.68, df=84, p=0.000, RMSEA = 0.065, SRMR = 0.056 and CFI=0.92). Regarding test-retest validity there were no significant differences between test and retest measures, when test (M=44.26±5.13) and retest (M=44.09±5.76) conditions; t(279)=0.52 (p=0.600).

Conclusions:

According to the results of our study, the questionnaire has shown reliability on measuring pro-social and anti-social behaviours in PE class. Therefore, the questionnaire can be used as an effective tool to help Albanian PE teachers and sports educators to understand the social and educational values dealing with sport in Albanian schools.

Keywords

  • pro-social
  • antisocial
  • values
  • questionnaire
  • physical education

Full Text

INTRODUCTION

In recent years, sport and Physical Education (PE) are getting special attention because of the benefits that they give to a person. Ghildiyal [1] states that “Sport and PE helps an individual much more than in physical aspects alone. It builds character, teaches and develops strategic thinking, analytical thinking, leadership skills, goal setting and risk taking”. Bailey [2] reported that PE helps children develop respect for their own body, themselves and others, and it makes them understand the benefits of physical activity (PA) on their health, and in the same time makes them more confident and increases their self-esteem. According to his findings, PE and sport can bring a variety of outcomes which can be understood in terms of children’s development, which are concentrated in 5 important areas: physical, lifestyle, affectiveness, social, and cognitive.

Concentrating on values related to sport and PE, our first research focus has been “fair play”, starting with the study of "Fair Play for Kids [3]: effects on the moral development of children in physical education”. The study suggested that values of sportsmanship are most effectively supported when students are given the theory and in the same time the opportunities to practice and implement these theories through playing and games. Hassandra, et al., [4] reported that Fair Play is the sum of social and moral values divided to individuals through sport.

Fair Play has been defined by some authors as follows: “Fair play means not just playing by rules, but also respecting others, participating always with the right spirit and attitude, valuing equal opportunity and behaving with responsibility towards a teammate or a player” [5]. “Demonstrating respect for the roles of opponents and referees” [6]. “Respecting other students rights to learn and to participate [7]. In the Code of Conduct, the IOC defines Fair Play as a set of actions dealing with [8]: Be True - Always do your best, do not try to fix an event, Be Safe- Never beg for your sport or your competition, Be Careful- Do not share information that could be used for betting purposes, Be Open- If you are approached to cheat, do not keep silent, speak out! “Fair Play is a complex concept that comprises and embodies a number of fundamental values that are not only integrated to sport but relevant in everyday life”[9].

Also, a very important question to answer is why and who promotes fair play [10,11]. Pinheiro, et al., [12] underwrite that Fair Play is something related mostly to sport, and it can be learned between mates of a team or class, and it is something transmitted from PE teachers, coaches, and parents, figure 1. Reviewing all the definitions of fair play we can highlight the importance that it plays in sport and PE, especially seen as an applied concept which can teach sets of general, moral or social values. Even that is generally agreed that sport teaches values, this depends upon the way sport is played, taught and practiced, because this values can be transformed from positive to negative [13]. Evaluating it from this point of view, we encountered many studies with intervention programs to change student’s behaviour, where PE teachers play a very important role.

Hassandra, et al., [4] worked in a fair play intervention program on Olympic Education; the study took place in 4 elementary schools in Greece. One hundred and twenty-six 5th grade students participated in the study, from which 66 were in the experimental group and 60 in the control one. To measure the level of fair play, “Fair Play Questionnaire in Physical Education” (FPQ-PE) [14]. The intervention had an immediate effect on the control group, so the program based on theoretical principles can be effective in promoting socio-moral development on students. The same questionnaire was validated and applied also in Turkey, the study showed effects on all subscales in favour of girls [15].

On the same line goes the research on moral growth and Fair Play [16]. An intervention program was implemented on 7th to 9th grade students, in a mountain village in the province of Parma. Students modified their behaviour, increased their self-esteem and self-efficacy, they acquired positive emotions and experiences during physical education classes.

Figure 1.

Fair play and components that interact together to implement values.

Another intervention is the reaserch with the investigation on the effects of a dependent group-oriented contingency on supportive and non-supportive fair play behaviours [6]. The study involves 6th grade students in a volleyball game and it was effective on the dependent group-oriented contingency, students showed good improvement on supportive behaviour during volleyball game in PE. Vidoni and Ward [17] implemented an intervention program on seven students for 18 lessons with duration of 40 minutes per lesson. The instructions consisted in: (a) students developing a chart with fair play cues to be accomplished during the lesson; (b) the teacher’s approval of the concepts of Fair Play expressed through students’ behaviours during PE class; (c) pinpointing positive fair play behaviour at the end of the lesson. The intervention and data collection were concentrated on students’ active participation in helpful and harmful behaviour. As results, the instructions students were provided with to promote their perception of Fair Play increased their level of participation. Moreover, from the intervention a positive change about helpful behaviour was detected along with a decrease in the amount of harmful behaviour.

As highlighted above the values learn through sport and especially through PE class can be a very effective tool through which PE teachers can work and improve their students’ attitudes and behaviours. The perception of values in education systems can somehow be different in different countries and cultures. Therefore, regarding Albanian education system we faced the need of evaluating these values, and to carry out this evaluation we are convinced that is important to evaluate practical instruments which may be applied.

For this reason, the main aim of this study was to translate and validate into Albanian language the questionnaire that measures/evaluates pro-social and antisocial behaviours in PE class [14]. In so doing, we are convinced that we will collect data to build and put into practice a tool capable of detecting students behaviours about values dealing with Fair Play and plan an effective intervention to cover their needs.

MATERIAL AND METHODS

To conduct this study the Fair Play Questionnaire in Physical Education (FPQ-PE) by Hassandra, et al. [14] was used. The questionnaire was translated and validated into Albanian language from the English 15-items-version used in the study of Mirzeoğlu [15]. The questionnaire consisted in two pro-social sub-scales (“respect towards teammates”, “respect for conventions”) and two antisocial (“gamesmanship”, “cheating”) and it was based on a 1 to 5 Likert scale detecting the level of frequency (1=Never, 5= Always).

The methods that were used to validate the questionnaire were based in three steps; 1) Translation and Back Translation, 2) Factor Analysis, and 3) Test-Retest Validity. 1) Translation and Back Translation- The questionnaire was translated from three experts of the field (PE teachers and sport experts) who were proficient in English language and the process of back translation was done from experts of Albanian and English language. 2) Factor Analysis- We used the Exploratory Factor Analysis (EFA), Reliability reporting Cronbach Alpha (CA) coefficient, and Confirmatory Factor Analysis (CFA). A total of 597 middle school students from Tirana, Albania, were involved. For the EFA, Reliability (CA) and test-rates validity, a sample of 280 middle school students was taken (age=13.22±1.22 years) and for the CFA another sample size of 317 students was used (age=14.32±7.3 years). 3) Test-Retest validity- The questionnaire was submitted to the same students two times with an interval of 3 weeks between them. Additionally, the questionnaires were submitted to the students in the same conditions. In both times, students completed the questionnaire before starting their lessons and it took them between 5-7 minutes.

RESULTS

Translation and Back Translation

The process of translation was made adapting all of the items into Albanian language, being that some words were considered “strong” on their first meaning for Albanian language. The group of experts decide to use “break the rules” instead of “cheating “and the “teammates” was translated as teammates/classmates. Regarding the back translation there were not changes from the original version, except the words “cheating” with “break the rules” and for the word “teammates’” where used two words “teammates” and “classmates”. This is because in Albanian language the word “teammates” is used especially on the context of competitive sport, and in PE classes both words are used “teammates” and “classmates”(full version at the appendix).

Exploratory Factor Analysis- (EFA)

For the EFA, Kaiser-Meyer-Olkin (KMO) coefficient and Bartlett’s Test of Sphericity values were calculated: KMO is > than 0.5 and Bartlett’s Test is significant < 0.01 (KMO-0.820, x2=1153.330; p=0.000). The numbers of factors were four (without fixing the number of factors), that is to say, two factors in antisocial values (cheating and gamesmanship) and two factors in pro-social values (respect conventions and respect towards teammates). All items load with their correspondent factor, as shown in Table 1.

Reliability

The CA coefficient was used to evaluate the reliability of the questionnaire. The CA coefficients for questions representing the antisocial sub-scale were: cheating 0.765, and gamesmanship 0.742. On the other hand, for the questions representing pro-social sub-scale the results were: respect convention 0.683 and respect towards teammates 0.616. Evaluating the CA for two sub-scales (pro-social and antisocial) the coefficient was 0.803 for antisocial, and 0.717 for pro-social.

Table 1.

Factor Analysis of FPQ-PE

Items / FactorsF1F2F3F4
Cheating
I cheat0.759
I cheat if it helps me win0.770
I cheat if I am sure that I am not caught0.756
Gamesmanship
I swear to my opponents0.365
I try to disturb my opponents0.775
I try to get my opponents angry0.758
I try to demoralize my opponents0.671
Respect Conventions
I shake my opponents’ hands no matter I win or lose0.824
I shake my opponents’ hands when the game finishes0.857
I congratulate my opponents when I lose the game0.583
I congratulate my teammates on their good performance0.333
Respect towards Teammates
I reward my teammates’ good efforts0.623
I support my teammates0.618
I stand by my teammates0.705
I help my teammates0.653
Figure 2.

CFA and error of variance for FPQ-PE.

Table 2.

Fit index of FPQ-PE

Fit indexesValues
χ2 - Chi-square196.68 (p=0.000)
Df - Degrees of freedom84
χ2/df2.34
RMSEA- root mean square error of approximation0.065
SRMR- Standardized root mean square residual0.056
CFI- Comparative fit index,0.92
NFI- normed fit index,0.88
IFI- Incremental fit index0.92
TLI- Tucker-Lewis index0.90

Confirmatory Factor Analysis- (CFA)

Reporting CFA Model Fit, researchers use numerous goodness-of-fit indicators to assess a model. The most important to report are: Normed Fit Index (NFI), Tucker-Lewis Index (TLI), Comparative Fit Index (CFI), Root Mean Square Error of Approximation (RMSEA) and Incremental Fit Index (IFI) [16]. On the table 2 is reported Fit index, and in the figure 2 the CFA and error of variance for the FPQ-PE.

Test-Retest Validity

As mentioned above on the process of validity we used even the test-retest validity. There were no significant differences between test-retest measures, when test (M=44.26±5.13) and retest (M=44.09±5.76) when conditions; t(279) =0.52 (p=0.600).

DISCUSSION

The main purpose of the study was the validity and reliability of FPQ-PE into the Albanian language. To do so the process of validity as mentioned above was based in three steps. First, the translation and back translation of the questionnaire from experts of the field and the language was made. On the process of translation, the adaptation into Albanian language was done. For the back translation there were only small changes from the original version, just using different synonyms.

Secondly, the factor analysis was completed, in which we evaluated the response of 597 students from Tirana, Albania. EFA was accomplish with a sample size of 280 students, from the analysis KMO > than 0.5 and Bartlett's Test < 0.01 (KMO-0.820, x2=1153.330; p=0.000), have indicated that EFA can be performed. Without fixing the number of components all items were loaded in four factors and the smallest value was 0.30.

Comparing the EFA loading with the study of the 0.30 value is lower [15]; being that in their study the smallest value was 0.40, but regarding the values between 0.30 and 0.40 can be considered acceptable on EFA [19]. Once performed the EFA, we evaluated the CA coefficient, when pro-social and antisocial sub-scales were: 0.765 for cheating; 0.742 for gamesmanship; 0.683 for respect conventions and 0.616 for respect towards teammates. Separately, the reliability for two sub-scales was antisocial 0.803 and pro-social 0.717. Comparing the result of then CA coefficient with the original questionnaire [14], and the questionnaire translated and validated into Turkish language we can say that the questionnaire in Albanian language can be considered reliable [15]. All in all, the values in the original study were between 0.66 and 0.89, in the study of were between 0.37 and 0.86 and in our study that we have conducted the results were between 0.62 and 0.80 [15].

Moreover, regarding the factor analysis, the CFA was carried out with a sample size of 317 students. The analysis showed a good model fit (Chi-Square=196.68, df =84, p=0.000, RMSEA=0.065, SRMR=0.056 and CFI=0.92). According to Hu and Bentler [18] the cut-off criteria for several fit indexes should be RMSEA< 0.060, CFI> 0.95, TLI >0.95 which are even the fit index that authors prefer more for one-time analysis [19,18]. Schreiber et al. [19] are at the opinion that the cut off for the RMSEA need to be < 0.06 to 0.08 with confidence interval, SRMR ≤ 0.08, and the CFI needs to be > 0.95. But other authors are on the opinion that the cut-off criteria for the CFI, NFI and TLI can be acceptable on 0.90 [22-25]. For the values less than 0.90 for the TLI and NFI the model usually can be improved substantially [26,27].

The third step of validity was the test - retest validity, when the instrument was distributed to 280 students (mean age=13.22±1.22 yr) in two different times, with an interval of 3 weeks between them. There were no significant differences between test and retest measures, when the results for the test were (M=44.26±5.13) while the results of the retest were (M=44.09±5.76) conditions; t(279)=0.52, p=0.600.

Based on the general results, it can be said that the results of this study have supported our purpose. All items on the EFA were loading on the correspondent factors and the CF coefficients for the four sub-scales were between 0.60 and 0.80. Additionally, the CFA showed a good fit index and the test-retest measure had no significant differences between the first and the second measure. Therefore, the questionnaire into Albanian language can be potentially valuable on measuring and evaluating pro-social and antisocial behaviours in PE class. A future needed step will be a pilot study to test the instrument in Albania.

This questionnaire can be a useful instrument to measure and evaluate the response of Albanian children towards Fair Play behaviours during PE class, and in the same time it could give us the opportunity to evaluate the PE curriculum. Also the questionnaire can be used to compare and assess the responses of children from public and private schools. Furthermore, the instrument can also provide some valuable information of the students’ behaviours depending on their gender.

CONCLUSIONS

Fair Play behaviours are essential social behaviours for students to acquire throughout a PE class. These Fair play behaviours in PE class have been measured and evaluated in previous studies using FPQ-PE in Greek and Turkish language [14,15]. The main purpose of this work was to translate and validate these same questionnaires into Albanian language, producing by doing so a reliable questionnaire that could be used also in the Albanian education system.

Additionally, from the results obtained in this study, it can be asseverated that the questionnaire in the Albanian language can be considered reliable on measuring and evaluating pro-social and antisocial behaviours in PE class. All in all, the implementation of the questionnaire can be a useful addition to help Albanian PE teachers to improve their work and to assess the reality of students’ behaviour pattern in middle school, providing them with accurate information about the needs of possible intervention programs in PE class. The Albanian education system could use this instrument to evaluate and enhance the PE curriculum in its schools, and it could also be a useful tool for researchers in the field of PE.

ACKNOWLEDGMENTS

We would like to gratefully acknowledge financial support from the University of Rome “Foro Italico”. Thanks are also extended to the participants from two schools in Tirana, Albania, and their PE teachers; Dean Qefalia, Romina Bardhushi and Dritan Hoxhaj. Thanks are also addressed to the people that gave their contribution on the translation and back translation of the questionnaire; Sarah Egan, Didmar Ziu, Juel Jarani, Geri Piraniani, and Brunilda Karasani.

Appendix

Albanian version of the FPQ-PE Back Translation

Mashtrim Cheating

Shkel rregullat. I break the rules.

Shkel rregullat nëse më ndihmon të fitoj lojën. I break the rules if that helps me win.

Shkel rregullat në lojë kur jam i/e sigurt që nuk do më I break the rules if I am sure that I am not going to zbulojnë. get caught.

Jo korrektësi Gamesmanship

I ofendoj kundërshtarët e mi. I swear to my opponents. Përpiqem ti shqetësoj kundërshtarët e mi. I try to disturb my opponents.

Përpiqem ti nevrikos kundërshtarët e mi. I try to make my opponents angry.

Përpiqem ti demoralizoj/shkurajoj kundërshtarët e mi. I try to demoralize my opponents.

Respekt ndaj normave Respect Conventions

I jap/shtrëngoj dorën kundërshtarëve, pavarësisht nëse I shake my opponents’ hands no matter if I win or fitoj apo humbas. lose.

I jap/shtrëngoj dorën kundërshtarëve të mi në fund të lojës. I shake my opponents’ hands when the game

finishes. I përgëzoj kundërshtarët e mi kur humbas lojën I congratulate my opponents when I lose the

game.

I përgëzoj shokët e mi të klasës për lojën e tyre të mire. I congratulate my casemates on their good

performance.

Respekt kundrejt lojtarëve të klasës/skuadrës. Respect towards Teammates

I jap kurajo shokëve/shoqeve të mi/ja të klasës/skuadres. I reward my teammates’/casemates good efforts. I mbështes shokët/qet e mi/ja të klasës. I support my casemates.

Qëndroj pranë shokëve/shoqeve të mi/ja të klasës/skuadrs. I stand by my teammates’/casemates.

I ndihmoj shokët/shoqet e mi/ja të klasës. I help my casemates.

ACKNOWLEDGMENTS

We would like to gratefully acknowledge financial support from the University of Rome “Foro Italico”. Thanks are also extended to the participants from two schools in Tirana, Albania, and their PE teachers; Dean Qefalia, Romina Bardhushi and Dritan Hoxhaj. Thanks are also addressed to the people that gave their contribution on the translation and back translation of the questionnaire; Sarah Egan, Didmar Ziu, Juel Jarani, Geri Piraniani, and Brunilda Karasani.

REFERENCES

  1. Ghildiyal R. Role of Sports in the Development of an Individual and Role of Psychology in Sports. Mens Sana Monogr. 2015; 13(1): 165–170. doi: 10.4103/0973-1229.153335
  2. Bailey R. Physical education and sport in schools: A review of benefits and outcomes. J Sch Health. 2006; 76(8): 397–401.
  3. Gibbons SL, Ebbeck V, Weiss MR. Fair Play for Kids: effects on the moral development of children in physical education. Res Q Exerc Sport. 1995; 66(3): 247–255. doi: 10.1080/02701364.1995.10608839
  4. Hassandra M, Goudas M, Hatzigeorgiadis A, Theodorakis Y. A fair play intervention program in school Olympic education. Eur J Psvchology Educ. 2007;XXII(2):99–114. doi: 10.1007/BF03173516
  5. Siedentop D, Hastie PA, Van Der Mars H. Complete Guide to Sport Education 2nd ed. United States of America: Human Kinetics; 2011
  6. Vidoni C, Ward P. Effects of a dependent group-oriented contingency on middle school physical education students’ fair play behaviors. J Behav Educ. 2006; 15(2): 81–92. doi:101007/s10864-006-9012-z
  7. Patrick CA, Ward P, Crouch DW. Effects of Holding Students Accountable for Social Behaviors during Volleyball Games in Elementary Physical Education. J Teach Phys Educ. 1998; 17(2): 143–156. doi: 10.1123/jtpe.17.2.143
  8. International Olympic Committee. Fair Play, Cod of Conduct. https://www.olympic.org/the-ioc.
  9. International Fair Play Committee. Fair Play. http://www.fairplayinternational.org/what-is-fair-play.
  10. Ortenburger D, Wasik J, Gora T, et al. Taekwon-do: a chance to develop social skills. Ido Movement for Culture Journal of Martial Arts Anthropology 2017; 17: 14–18. doi: 10.14589/ido.17.4.3
  11. Wasik J. Three Areas of Taekwon-do Identification and Practice. Ido Movement for Culture Journal of Martial Arts Anthropology 2014; 14: 22–26. doi: 10.14589/ido.14.3.3
  12. Pinheiro V, Camerino O, Sequeira P. Resources to promote fair play in sports initiation Tools to increase fair play in the initial learning of sports. [Recursos para potenciar el fair play en la iniciación deportiva Tools to increase fair play in the initial learning of sports] Rrtos. Nuevas Tendencias en Educación Fisica, Deporte y Recreación; 2013. Spanish.
  13. Butcher, R & Schneider A. Fair Play as Respect for the Game. J Philos Sport. 1998; 25(1): 1–22. doi: 10.1080/00948705.1998.9714565
  14. Hassandra M, Goudas M, Hatzigeorgiadis A TY. Development of a questionnaire assessing fair play in elementary school physical education. Athlitiki Psychol. 2002; 13: 105–126.
  15. Mirzeoğlu N. The validity and reliability of Turkish version of fair play questionnaire in Physical Education (FPQ-PE) and an implementation. Educ Res Rev Full 2015; 10(17): 2469–2480. doi: 10.5897/ERR2015.2402
  16. Isidori E, Vossel T, Maulini C. Developing Educational Values through Sport and Physical Activity : A case study within school education in Italy. Educ Artis Gymnast. 2010; 4: 53–63
  17. Vidoni C, Ward P. Effects of fair play instruction on student social skills during a middle school sport education unit. Phys Educ Sport Pedagog. 2009; 14(3): 285–310. doi: 10.1080/17408980802225818
  18. Schreiber JB, Stage FK, King J, Nora A, Barlow EA. Reporting structural equation modeling and confirmatory factor analysis results: A review. J Educ Res. 2006; 99(6): 323–338. doi: 10.3200/JOER.99.6.323-338
  19. Tabachnick BG, Fidell LS. Using multivariate satistics 5th ed. Miami United State of America: Ally&Bacon, Inc, Needham Heights; 2001
  20. Hu L, Bentler PM. Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Struct Equ Model A Multidiscip J. 1999; 6(1): 1–55. doi: 10.1080/10705519909540118
  21. Yu C. Evaluation of model fit indices for latent variable models with categorical and continuous outcomes. Proceeding of the annual conference of American Educational Research Association;2002 April 4; New Orleans, Louisiana.
  22. Bentler PM, Bonett D. Significance tests and goodness of fit in the analysis of covariance structures. Psychol Bull. 1980; 88: 588–606. doi: 10.1037/0033-2909.88.3.588
  23. Crocker J, Luhtanen RK, Cooper ML. Contingencies of Self-Worth in College Students: Theory and Measurement. J Pers Soc Psychol. 2003; 85(5): 894–908. doi: 10.1037/0022-351485.5.894
  24. Van der Vegt GS, Emans BJM, Van der Vliert E. Patterns of interdependence in work teams: A two-level investigation of the relations with job and team satisfaction. Pers Psychol. 2001; 54: 51–69. doi: 10.1111/j.1744-6570.2001.tb00085.x
  25. Bentler PM. On the fit of models to covariances and methodology to the Bulletin. Psychol Bull. 1992; 112(3): 400–404.
  26. Geurts SAE, Kompiera MAJ, Roxburgh S, Houtmanc ILD. Does Work–Home Interference mediate the relationship between workload and well-being? J Vocat Behav. 2003; 63(3): 532–559. doi: 10.1016/S0001-8791(02)00025-8
  27. Probst TM. Development and validation of the Job Security Index and the Job Security Satisfaction scale: A classical test theory and IRT approach. J Occup Organ Psychol. 2003; (76): 451–467. doi: 10.1348/096317903322591587

Phys Act Rev. 2019;7:143-151.DOI: 10.16926/par.2019.07.17

How to Cite

Buzi, E., Jarani, J., & Isidori, E. (2019). Pro-social and antisocial values in physical education. The validity and reliability of fair play questionnaire in physical education (FPQ-PE) into Albanian language. Physical Activity Review, 7, 143-151. https://doi.org/10.16926/par.2019.07.17