Education in the Knowledge Society 22 (2021)

Effectiveness of E-learning Environments in Developing Skills for Designing E-tivities Based on Gamification for Teachers of Technology in Gaza

Eficacia de los entornos de aprendizaje electrónico en el desarrollo de habilidades para el diseño de actividades electrónicas basado en la gamificación para los profesores de tecnología en Gaza

Akram Firwana^a, Mohammad Abu Shouqer^b, Magdy Aqel^c

^aThe Islamic University of Gaza, Gaza, Palestine.

https://orcid.org/0000-0002-0632-0457a.firwana@gmail.com

^bThe Islamic University of Gaza, Gaza, Palestine.

https://orcid.org/0000-0003-2783-0699mshgair@iugaza.edu.ps

^cThe Islamic University of Gaza, Gaza, Palestine.

https://orcid.org/0000-0002-3589-816Xmsaqel@iugaza.edu.ps

ABSTRACT

The Corona Global Pandemic created challenges for teachers and students in using E-learning tools in the teaching and learning process. Thus, training teachers to use these tools was extremely crucial. The current study examined the effectiveness of E-learning environments on developing the skills to design E-tivities based on Gamification for Gaza technology teachers. The researchers followed the quasi-experimental approach for two randomly selected experimental groups. The first experimental group was taught via E-learning social environment Edmodo, while the second experimental group was taught via the personal E-learning environment WordPress. Every group consists of 30 teachers teaching Information Technology for secondary students. The group equivalence was adjusted before the experiment in designing E-tivities skills based on gamification. To collect data, the researchers prepared an observation card of the skills for designing E-tivities based on gamification. The observation card dealt with the design tools and their sub-indicators, and it was applied before and after the intervention phase. The results showed that there were no statistically significant differences at the level (α ≤ 0.05) between the mean of the teachers’ scores in the experimental social environment group Edmodo, and the experimental personal learning environment group WordPress in the post-application of the observation card for designing E-tivities skills based on gamification. Additionally, the findings revealed great effectiveness of E-learning social environment Edmodo and the personal E-learning environment WordPress on developing skills for designing E-tivities based on gamification. In light of these results, it is recommended that social and personal E-learning environments should be employed in developing the skills of teachers and improving their experiences. This helps organize and display information in addition to facilitating communication between the components of the educational process and the benefit of using these environments in training teachers under the Global pandemic, Coronavirus, COVID-19.

Keywords:
E-learning
Social Learning Environments
Personal Learning Environments
Edmodo, WordPress, Gamification
E-tivities
Salmon five Stage Model

RESUMEN

La pandemia mundial del Coronavirus formuló desafíos tanto para los profesores como para los estudiantes con respecto al uso de herramientas de aprendizaje electrónico en el marco del proceso de enseñanza y aprendizaje. Así las cosas, la capacitación que los maestros necesitan para utilizar aquellas herramientas era sumamente crucial. En este estudio se examinó la eficacia de los entornos de aprendizaje electrónico en el desarrollo de las aptitudes para diseñar actividades electrónicas basadas en el juego por parte de los profesores de tecnología de Gaza. Los investigadores siguieron un enfoque cuasi experimental para el cual se recurrió a dos grupos experimentales seleccionados al azar. Al primer grupo experimental se le enseñó a través del entorno social de aprendizaje electrónico Edmodo; al segundo grupo experimental se le enseñó a través del entorno personal de aprendizaje electrónico WordPress. Cada grupo constó de 30 profesores que enseñan Tecnología de la Información en escuelas secundarias. La equivalencia del grupo se ajustó antes del experimento en el diseño de las habilidades de E-actividades basadas en el juego. Para recoger datos, los investigadores prepararon una tarjeta de observación de las habilidades para el diseño de E-actividades basadas en la gamificación. La tarjeta de observación tiene que ver con las herramientas de diseño y sus subindicadores, y se aplicó antes y después de la fase de intervención. Los resultados mostraron que no hubo diferencias estadísticamente significativas a un intervalo de confianza de 95% (α ≤ 0,05) entre la media de las puntuaciones de los profesores en el grupo experimental de entorno social Edmodo y el grupo experimental de entorno personal de aprendizaje WordPress después de la-aplicación de la tarjeta de observación para el diseño de las habilidades de E-actividades basadas en la gamificación. Por otra parte, los hallazgos revelaron una gran efectividad del entorno social de aprendizaje electrónico Edmodo y del entorno personal de aprendizaje electrónico WordPress en el desarrollo de habilidades para el diseño de actividades electrónicas basadas en la gamificación. A la luz de estos resultados, se recomienda el empleo de entornos sociales y personales de aprendizaje electrónico para el desarrollo de las habilidades de los profesores, lo que se verá reflejado en una mejora de sus experiencias. Esto es útil para organizar y mostrar la información, además de facilitar la comunicación entre los componentes del proceso educativo y el beneficio de utilizar estos entornos en la formación de los profesores en el marco de la pandemia mundial.

Palabras clave:
E-learning
Entornos Sociales de Aprendizaje
Entornos Personales de Aprendizaje
Edmodo, WordPress, Gamificación
E-actividades
El modelo de las cinco etapas

1. Introduction

In the current Global pandemic, Coronavirus, COVID-19, the high value of technology in the teaching process has been appeared clearly. As the educational process was interrupted in many countries of the world. The ability of the countries to continue education has been affected and was directed to rely on the skills of the teachers in using E-learning instead. UNICEF (2020) has also raised an important question within a proposal to develop a serious re-opening vision after the Global pandemic, Coronavirus, COVID-19 on the availability of high-quality E-learning in those countries that can be used and accessed within the same framework as what the education focuses on. One of the preparation ways to catch-up with the exponential spread of COVID-19 is staff preparation and training. This included arrangements for safeguarding, division of work between departments, mechanisms for teachers to remain in touch collectively for mutual support, and brief simple updates on learning technologies they already familiar with. Many institutions had plans to make greater use of technology in teaching, but the outbreak of COVID-19 meant that changes intended to occur over months or years had to be implemented in a few days (Daniel, 2020). Accordingly, this maent that the education system in times of pandemic has had to be urgently and unexpectedly transformed into a virtual modality (Fardoun et al., 2020). The proposal also focuses on the necessity to implement innovative methods and approaches to support teachers’ professional development online, particularly, after the constant discontinuation of the development of these cadres since teachers are challenged to employ E-learning in the next stage of instruction. There is an urgent need to use appropriate E-learning environments that could be employed in the training process. This strengthens the modern approach in adopting such environments in teacher-training programs in the process of developing teachers’ skills.

Apparently, the use of E-learning environments of various types and objectives in the process of developing teachers’ skills has become a new orientation in teachers’ training programs and has provided them with the skills and knowledge in the educational institutions. Consequently, the professional growth of teachers can be achieved, this is by meeting their needs through high-quality, continuous and innovative programs. E-learning has become a solution that enhances the professional growth for educators (Al-Dowayan and Mustafa, 2019:193).

Edmodo is considered the latest social network which creates an environment that stimulates and enhances student-teacher interaction and facilitates learning. Some educators see Edmondo as a new conquest in the field of education that brings advantages and benefits for both teachers and students. Yet, others maintain that it is just a natural development of education technology. Additionally, key components that make Edmondo a preferred environment for teachers and learners in the education process can be summarized as creating generic and sub-classes or groups, controlling learners’ accounts, viewing the latest learning activities, providing a field of discussion and communication, a library for uploading files and learning materials, assigning quizzes and E-tivities, and many other features. All these provide full of cooperation and practice in a social frame of interaction (Al-muqran, 2019: 123-124).

Second-generation Web applications, tools, and services also helped to generate personal learning environments that build on the learners’ suitable characteristics and learning styles and learn through various learning resources that can be accessed personally, and allow organized learning (Remod, 2017: 14).

Prendes et al. (2017) suggest that the concept of a personal E-learning environment is relatively new in educational research. But it can be distinguished as it is related to several well-known concepts such as learning styles, individual differences, self-organized learning. Žubrinić and Kalpić (2008) confirm that a personal E-learning environment is an environment that helps learners to control and manage their learning. Besides, this is to support those learners to set their personal learning goals to achieve the general learning goals. In the same concern, using tools such as WordPress and Wiki are also considered personal learning environments used to achieve personal learning that is based on the individual own self-experience. This diversity in E-learning environments has challenged the researchers to choose the best in the training process. In the same context, the current study investigates the effectiveness of the social E-learning environment Edmodo and the personal E-learning environment WordPress, on developing teachers’ designing E-tivities skills based on Gamification. Salmon, (2013) defined E-tivities as “frameworks for enabling active and participative online learning by individuals and groups” p.5. Several studies such as (Slèvin, 2006; Pettenati and Cigognini, 2009; Wright, 2014) have agreed that the key to active online learning is Salmon’s definition of E-tivities. These activities were considered as an important resource that allows teachers who teach students in a variety of electronic environments to design meaningful activities. In the same concern, Salmon developed a Five-Stage Model that creates a general framework for designing E-tivities, intending to guide teachers toward more collaborative and cooperative activities with E-learning tools and environments, develop critical thinking, metacognitive thinking, and focuses on creative skills, such as discovery and innovation, and practice (Ruzmetova, 2018: 283).

Gamification is one of the modern concepts that can be applied in designing E-tivities. Benhadj et al. (2019) assure that using gamification in instruction is necessary and unavoidable and teachers should be encouraged to use it as it makes a significant difference in students’ learning. This concept refers to the application of game-design elements and game principles in non-game contexts. Deterding et al. (2011) define gamification as game-based mechanics, aesthetics, and game thinking to engage individuals, motivate them, enhance their learning and problem solving (Kapp, 2012). This can change behaviors in non-game situations in an educational context (Robson et al., 2015). Gamification is based on a range of concepts such as motivation and encouragement, effectiveness, and immediate feedback (Ibn al-Hadlaq, 2019: 315).

Many applications such as Kahoot offer some gamification mechanisms. Kahoot is a platform that contains electronic tests based on gamification mechanisms. It makes learning more enjoyable, interactive, and competitive since it provides many elements of gamification mechanisms such as the timer, visualization symbol, and leaderboard (Kaur and Naderajan, 2019: 5). Pilař et al. (2020), Hernández-Ramos and Belmonte (2020) and Benhadj et al. (2019) assure that from students’ point of view, using Kahoot and Classdojo in teaching have a positive effect, and these applications are practical and fun that encourage and motivate learners to learn. To make E-tivities design skills based on gamification, the researchers employed some of the gamification application such as Kahoot, Classdojo, and Socrative and the five stages of Salomon’s model in a complementary way with the tools for designing E-tivities, as these activities can only be designed by the teacher with a set of tools and applications available online.

The researchers note that there is a variety of tools used in designing E-tivities, and some studies designed their tools according to their perception of E-tivities such as Adams (2019) and El-Tabakh and Ismail (2019). On the other hand, some studies employed the tools offered by learning management systems such as Moodle, Blackboard as the Pineda Hoyos and Tamayo Cano (2016), Juhani (2018) in the design of E-tivities, Dempsey et al. (2018) used a blog for designing E-tivities. Similarly, some studies used the tools of gamification such as Kahoot or Classdojo (Baydas and Cicek, 2019; Hernández-Ramos and Belmonte, 2020; Benhadj et al., 2019).

Due to the diversity of these tools, the researchers faced a real challenge in choosing the right tools to design E-tivities, which give teachers great flexibility in designing their electronic activities. Thus, in this study, the right tools have been chosen by a group of experts including the researchers who have classified them into six domains as follows: Video platforms, educational blogs, learning management system, graphic design editors, mind mapping, cloud computing applications, and gamification applications.

To conclude, it can be said that developing the skills of technology teachers in designing activities based on gamification become a vital requirement, especially in the Global Pandemic Coronavirus COVID-19 (García-Peñalvo and Corell, 2020). This provides those teachers with many tools that facilitate their design and motivate their students to learn. In addition, this could help in training the teachers to use social and personal E-learning environments.

To achieve this, the researchers used a quasi-experimental design with two experimental groups, the first experimental group used the social E-learning environment Edmodo and the second one used the personal E-learning environment WordPress. This procedure aimed to develop teachers’ skills in designing E-tivities based on gamification. The quasi-experimental design which is used in this study included a pre-application and post-application of observation card of designing E-tivities skills based on gamification on both experimental groups to reach the final results of this study.

1.1. Objectives of the study

The study aims to identify the effectiveness of both the social E-learning environment Edmodo and the personal E-learning environment WordPress in developing the skills of technology teachers in designing activities based on gamification. This can be done through using 12 various technological tools and applications, distributed in 6 domains: Video platforms, educational blogs, learning management system, graphic design editors, mind mapping, cloud computing applications, and gamification applications, the variety of tools is intended to provide the teacher with a variety of designs to suit their lesson goals and students’ needs in light of the Salamon’s model of online active learning.

1.2. Study problem

During Global Pandemic Coronaviruses COVID-19, the Palestinian Ministry of Education faced real challenges to continue training teachers. Therefore, it was a necessity that they should find suitable alternatives to make their training applicable. In this pandemic, teachers were unable to contact their students, and did not have the tools and skills to design E-tivities to help them develop their teaching skills and facilitate students’ motivation to learn during this emergency. This weakness illustrates more clearly the strategic plan for education 2017-2022, which considered that there is a lack of professional competencies for teachers in the field of employing technology to design E-tivities and educational materials. There are approximately 80% of technology periods that do not employ supportive E-tivities. In this context, the ministry of education adopted the development of teachers’ professional competencies in technology in general (Ministry of Education and Higher Education, 2017).

The researchers found a real exciting problem and need to develop teachers’ skills in employing E-learning, and the use of their tools in designing E- tivities. Also, several studies have confirmed that there is an urgent need to become a twenty-first-century teacher. A teacher who possesses knowledge, skills, and competences in the use of technology and the design of E-tivities that align E-learning environments, and active online learning such as Tican and Deniz (2019), Al-shimmery (2019), Al-Dosari (2018), Ruzmetova (2018), and Al-kandry (2013). It was recommended in many conferences, such as a most recent conference: the Digital Education Conference which was held at Cairo University in 2018, entitled: (Digital Education in the Arab World - Challenges of the Present and Future Visions). The Arab Educational, Scientific and Literature Foundation, which stressed the need to develop teachers’ skills in preparing electronic content, E-tivities, and digital applications. This is related to the educational controls and conditions to ensure quality of education. Similalry, there was the Second International Learning and Education Conference in the Digital World/Smart Learning, held in 2017 at the National University of Najah, Palestine. It emphasized the need to adopt modern teaching strategies and develop teachers’ skills in building and designing their own teaching materials, their E- tivities, and spreading the smart learning culture among learners.

The researchers found a great challenge to decide the best E-learning environments due to their huge diversity. They decided to compare the social E-learning environment Edmodo with the personal E-learning environment WordPress to find the best environment to rely on in the future training and courses in the Ministry of Higher Education. The researchers prepared an open questionnaire consisting of 8 questions that need to express an opinion about E-tivities and their importance, and teachers need for them and responded to this questionnaire which shows this resolution.

The respondents were 33, distributed as follows: 20 Technology Instructor, 6 Academics and Specialists, 4 Technologists, and 3 Technological Supervisors. The results of this questionnaire concluded the following:

In light of all of the above, the researchers were able to verify the presence of a real problem related to the necessity of developing the skills of technology teachers in designing E-tivities based on gamification.

1.3. Importance of the study

The importance of this study is because:

2. Literature Review

2.1. E-learning Environments

First of all, E-learning describes learning which is delivered fully online whereas technology mediates the learning process. Teaching is entirley delivered via Internet, and students and instructors are not required to be available at the same time and place (Gros and García-Peñalvo, 2016). Several studies in educational literature dealt with the concept of e-learning environments. For example, Ibrahim et al (2015) define the e-learning environment as: “A range of social networking services such as micro-blogging, video and images sharing, work together to create an educational environment that allows the learner to learn in a self-appropriate manner for their characteristics” the researchers define it as The electronic environment that includes tools and technology for transmitting information from devices and networks, and is equipped with all facilities and usability standards that allow educational and learning practices, socially and personally, interactively between the student, teacher, and content; in light of a specific educational design; contributes to the achievement of the required educational goals. Many studies dealt with the social learning environment Edmodo like Altunkaya and Ayrancı (2020), which aimed to identifying the effects of academic writing instruction using Edmodo environment on students’ achievement. The researchers measured students’ achievement by using an achievement test and investigated the students’ opinions about the E-learning environment. The sample consists of 108 students divided into two groups the control group, and the experimental group. The study results indicate that the experimental group achievement in academic writing is higher than the control group achievement. Tamrin and Basri (2020) also aimed to understand students’ perceptions about the use of the Edmodo environment in English language instruction and used the descriptive qualitative approach. The researchers used a questionnaire and an interview to know the role of this environment in explaining the students learning style and improving their performance. The study concluded that students prefer to learn online using this environment. Sugito et al. (2019) measured the impact of the Edmodo environment on the students’ science achievement and their attitudes. The researchers used the quasi-experimental method for experimental and control groups The sample consisted of 124 students. They used a questionnaire to measure students’ attitudes toward Edmodo, and a test to measure students’ achievement. These results indicate the effect of Edmodo on increasing student attitudes and achievement toward science.

Žubrinić and Kalpić (2008) considered CMS Content Management Systems such as WordPress and Wiki editors as personal E-learning environments that customize educational content to suit the trainee needs and to achieve his personal learning goals and gaining experience.

The researchers benefited from these studies in defining the features of the Edmodo social E-learning environment, and determining the advantages of this environment in the training process, as well as for the personal E-learning environment WordPress, which provides tools that allow the trainees to build their own learning content, and presented a flexible environment allows them to learn freely, discover Knowledge, and develop their personal skills.

2.2. E-tivities & Gamification

The concept of electronic activities is related to the nature of the expected tasks, and from the researchers’ point of view this concept is defined by Palma and Piteira (2008) as “Activities carried out in an E-learning environment such as: Engaging in dialog with teachers, as simultaneous activities, participating in discussion forums, e-testing, uploading files for later reading”, Al-Dosari (2018) defined it as: “A set of activities teachers design using technology-innovations applications: The Internet, e-mail, chat rooms, and social media based on the principle of complementarity, sequencing, and logical sequencing in giving students cumulative experience”, Salmon (2013) defines E-tivities as “frameworks for enabling active and participative online learning by individuals and groups”.

Dempsey et al. (2018) study provided a perception of the structure of E-tivities by using the blog. To implement E-tivities, the researchers relied on a TPACK framework that used blog technology to provide an opportunity for students to gather research articles, and comment on other students’ blogs. The study concluded that 69% of the students believed that blogs were rich in content, and 82% of the research activity discussions were mission-oriented, 73% emphasized that their friends’ blogs were inspiring for them, about 76% indicated that the blog activity was appropriate, and enhance their reading ability and comment, almost 76% confirmed that the blog facilitated knowledge transferring to them, and 62% expressed their satisfaction with E-tivities.

Pineda Hoyos and Tamayo Cano (2016) used Moodle’s E-tivities and electronic forums, questionnaires, chat rooms, and appointments, to train teachers on electronic supervision concepts and E-tivities. The researchers made a case study for 20 teachers with no prior experience in designing E-tivities or in electronic supervising concepts. They were assigned to a number of tasks, the most important one is describing strategies and activities that can be integrated into the Salmon model. The results showed that teachers embodied many of the characteristics suggested by Salmon’s model of E-tivities.

Gamification is a design process where elements or mechanics in gaming are added to a non-game application or system (Shane et al., 2020). Cordero-Brito and Mena (2020) and Rojas-López et al. (2019) depended on gamification components which were points, badges, avatars, and a leaderboard. They revealed how gamification over time gained importance. The main conclusion of these studies indicated that gamification improved engagement with the students to succeed in solving the challenges successfully and it increased motivation. While Baydas and Cicek (2019) used Kahoot as a gamification application to measure the factors that may affect the process of designing gamification in university education. Their study concluded that using cooperative and gamification mechanisms in the learning environment increased students’ participation. In addition, Adams (2019) proposed a framework for gamification educational design principles to facilitate student participation in E-learning environments. This study concluded the effectiveness of integrating reward and well-designed feedback as one of the gamification elements and integrating it with learning activities. On the other hand, Juhani (2018) employed the gamification tools provided by the Blackboard system to develop mathematical problem-solving skills for gifted female students in the first year of secondary school. The study recommended benefiting from learning gamification in the educational field and to improve teachers learning gamification ‘skills, and encouraging teachers to make learning methods more exciting.

By reviewing the educational literature represented in the previous studies, which dealt with E-tivities in the learning process. The researchers recognized a wide variation in the nature of E-tivities, but all of them agreed that E-tivities are online activities carried out by students. Given the diversity and differences in the researchers’ illustrations of the E-tivity nature. The researchers decided that the Salmon Model for active learning via the Internet in determining the nature of E-tivities was clearly, maintaining that many studies follow it in preparing E-tivities in different E-learning environments, for example, Pineda Hoyos and Tamayo Cano study (2016).

3. The study Questions

The main study question is:

What is the effectiveness of E-learning environments in developing skills of designing E-tivities based on gamification for teachers of technology in Gaza?

This main question is divided into the following sub-questions:

3.1. Study hypotheses

4. Methodology

The current study followed the qualitative and the quantitative method to collect data to describe and analyze the scores of the two study groups in designing e- tivities skills based on gamification.

4.1. Study Design

The current study compared the effectiveness of the social E-learning environment Edmodo and the personal E-learning environment WordPress on developing technology teachers’ skills in designing E-tivities based on gamification. A semi-experimental design is used, and the sample of the study is divided into two experimental groups:

The semi-experimental design used in this study included a pre-application and post-application of observation card of designing E-tivities skills based on gamification on both experimental groups. after they passed the experimental process and training them on those skills as shown in Figure 1.

4.2. Study subjects

4.2.1. The study community

All the technology teachers in the governmental schools in Gaza strip, from all the directorates of education, were 269 male and female teachers.

4.2.2. The study sample

The researchers used a pilot sample of 30 teachers different from the original sample of the study. To adjust the study tool, and verify its validity and reliability, then the researchers selected the current quasi-experimental study sample consisting of 60 technology teachers to work in secondary schools, then they divided the sample divided randomly into two experimental groups, the first experimental group consisted of 30 teachers used the social E-learning environment Edmodo, and the second experimental group consisted of 30 teachers and used the personal E-learning environment WordPress.

4.3. Study Variables

The study contains the following variables:

4.4. Procedures and steps for carrying out the study

Researchers used an open questionnaire to define the research problem and its dimensions. The questionnaire was introduced to experts and teachers, to review the problems of designing E-tivities in general and using in the process of teaching and E-learning; to determine the problem. In light of its results, the researchers concluded that there was a real problem that was required to conduct this study. So, they have a clear vision to put the study questions and hypotheses. They found that the qualitative method is suitable to describe the quantitative data that is collected from the study tool, and they identified the study community 269 technology teachers in government schools, researchers applied the semi-experimental design to two experimental groups. The study sample consists of 60 teachers divided randomly into two groups, 30 teachers in the first experimental group used the Edmodo social E-learning environment, and 30 teachers in the second experimental group used the personal E-learning environment WordPress to know the effectiveness of both environments on developing the design skills of e-activities based on gamification. Researchers held a workshop with 7 experts in the field of educational technology and e-learning on Tuesday, 21/01/2020 to identify tools and applications that will be used in designing E-tivities based on gamification. They identify 12 tools and applications to use for training teachers to develop their skills in designing E-tivities based on gamification. In this workshop, they identify 6 main domains, tools classified as it is shown in Table 1.

After the previous expert workshop, the researchers built an observation design skills card for designing E-tivities based on gamification, included evaluation indicators for each item, to ensure the reliability of this tool for the evaluation process. They applied it to a pilot study of 30 teachers different from the main study sample to verify the validity and reliability of the tool. The training included 6 training axes that included several training topics as shown in Table 2.

The Edmodo social e-learning environment and the personal e-learning environment WordPress were prepared and each group was trained to use their e-environment. Before the beginning of the experiment, researchers applied an observation design skills card of E-tivities based on gamification to the two study groups, to control groups equivalence, in two sessions for each trainee in the two groups, the evaluation process divided into two parts the trainer and his assistant, using the Teamviewer program. The trainer contacted directly with each trainee and noticed his/her performance by sharing his/her desktop using the program, the evaluation process took about a week to evaluate all skills of the two study groups. Then the researchers carried out the study remotely on April 2020 and the experiment carried out by training the first experimental group using the social E-learning environment Edmodo and communicating with the trainees socially using that environment and in the other side the second experimental group trained to use the personal E-learning environment WordPress, where each trainee built his/her personal blog and organized in an appropriate ways to acquire designing E-tivities skills based on gamification. The post-application followed the same procedures of the pre-application, the trainer implements the observation design skills card for designing E-tivities skills based on gamification on the two study groups, to compare the effectiveness of the social E-learning environment Edmodo and the personal E-learning environment WordPress. The post-application takes place after the completion of training on designing E-tivities skills based on gamification in three sessions for each trainee in the two groups, and the evaluation process was carried out by the trainer and his assistant, by using Teamviewer. They contacted directly with each trainee and observed his/her performance by sharing his/her desktop using that program. The evaluation process took about two weeks to evaluate all skills for the two study groups. Researchers used appropriate statistical treatments SPSS to analyze the data, the researchers used several statistical methods such as Alpha Cronbach Coefficient, Pearson Correlation Coefficient, t-test for two dependent samples, and two independent samples, after verifying the validity and the reliability of these tests. Then they deduce the results and elicit the interpretation and discussion. Finally, they write recommendations and suggestions.

4.5. The Instruments

The researchers designed an observation design skills card to measure teachers’ skills in designing E-tivities based on gamification. This has been done after examining the educational literature that dealt with different tools and skills for designing these activities, such as Dempsey et al. (2018) that indicated the educational blog in designing E-tivities. Pineda Hoyos and Tamayo Cano (2016) focused on E-tivities and active learning via the Internet, as well as the study of El-Tabakh and Ismail (2019), and the study of Adams (2019), Baydas and Cicek (2019) which dealt with gamification design and use skills, The researchers aimed to use this card to:

4.5.1. Validity and Reliability of the Instrument

The researchers held a workshop to identify tools and applications that will be used in designing of E-tivities based on gamification. and extracting the main domains of these tools, then the researchers prepared a list of sub-skills for these tools and revised them to present them to another group of arbitrators, to verify their apparent sincerity in terms of clarity of the formulation of items, their suitability for measurement, and their adequacy to cover each field.

The observation design skills card, defining the indicators for measuring each skill accurately, and to become ready to be applied to a pilot study consisting of 30 teachers, who joined similar courses before, and used different tools in designing electronic activities, to come out with its final draft consisting of 96 skills, distributed in six domains, and ranging at five-point Likert scale, this tool becomes, ready to be applied to a pilot study. The researchers benefited from the previous pilot study by calculating the following:

4.5.1.1. The agreement of the observers and the reliability of the estimates between them

To verify the observers’ agreement, the researchers used the Cooper formula, which showed a stability rate of 93.3% in the observation card, a high agreement ratio that makes the researchers reassured about the reliability of their tool in measuring what they were prepared for. The Table 3 shows the observers’ agreement and the reliability of the estimates between them:

4.5.1.2. Reliability of tools using the Alpha Cronbach coefficient

The researchers verified the reliability of the tools using the Cronbachs’ Alpha coefficient, where they found that the value of the reliability factor in the skills’ observation card ranged between (0.998 - 0.977) and that the total reliability factor of the card is equal to (0.994), and this indicates that the study instrument has a high degree of reliability and that when applied to the same sample in the same conditions will give almost the same results, and this makes the researchers comfortable to apply it to the study sample. The Table 4 shows the reliability of the observation design skills card using the Alpha Cronbachs’ coefficient for each item with its domain:

4.5.1.3. The Validity of the internal consistency of the observation design skills card designing E-tivities skills based on gamification

The researchers calculated the validity of the internal consistency of the observation designing skills card which consists of 96 items, by using Pearson’s correlation between the item and its scope, in the first domain: Skills of using video platforms in designing E- tivities, the correlation coefficients between the items, and this scope ranged between (0.943 - 0.596), and the coefficients of paragraphs correlation ranged with the second domain: Edublogs ‘skills in designing E-tivities are between (0.967 - 0.865). Items’ coefficients for the third domain: Skills of using the Learning Management System Canvas in designing E-tivities ranged between (0.999 - 0.956), and the fourth domain: Skills of using the graphic design editor Spark and mind mapping Coggle in designing E-tivities, the correlation coefficients between the items and this scope ranged between (0.995-0.931), and the coefficients of items correlation ranged with the fifth domain: Skills of using cloud computing applications Google Drive in designing E-tivities ranged between (0.945 - 0.854), and finally the sixth domain: Gamification tools and applications used in the design of E- tivities, correlation coefficients between the item and this scope ranged between (0.990 - 0.947), and all correlation coefficients between the item and its scope were significant at the level of (0.01), which are appropriate correlation coefficients indicating the high validity of internal consistency.

4.5.1.4. Validity of the structural consistency of the observation card of designing E-tivities based on gamification skills

To calculate the constructive validity that is concerned with the goals of the observation design skills card seek to achieve, the researchers measured the association of each domain of the observation designing skills card with the total score of the items, which appears as in the table 5.

Through the previous table, it is clear that correlation coefficients are high, ranging between (0.964 - 0.681), and this gives the researchers an indication of the structural validity of this tool and its applicability to the study sample.

4.6. Control of study variables

To verify the equivalence of the groups and control the study variables, an observation design skills card measures the skills of E-tivities based on gamification pre-applied on the two study groups. The two study groups checked for equivalence using a T-test for independent sample, to compare mean scores of the first experimental group Edmodo and mean scores for the second experimental group WordPress, in an observation card of the skills of designing E-tivities based on gamification, the results were as in the Table 6.

The Table 6 shows that it is clear that there are no statistically significant differences between the means of the two experimental groups in the observation card of the design of E-tivities based on gamification, which means that these skills are equivalent in the pre-application of this card.

5. Results

The study aimed to examine the effectiveness of E-learning environments on developing designing E-tivities skills based on gamification for technology teachers in Gaza, After statistical treatment. The researchers interpreted and explained the results in the light of previous studies, then developed recommendations and concluding proposals.

5.1. Study Questions’ answers

Here is an analysis of the research findings of the questions and hypotheses:

5.1.1. First question’s answer

The first question introduced as follows: “What are the proposed E-learning (social/personal) environments to develop the skills of technology teachers in designing E-tivities based on gamification?”

To answer this question, the researchers reviewed the literature on E-learning environments and found that there are different types of those environments can be used to develop skills, and those environments are an electronic community that includes tools and technology to transfer information from devices and networks, and equipped with all facilities and portability standards, permits educational use and learning practices interactively between the trainer, the trainee, and the content. It contributes to achieving the required educational goals, and from those environments. The researchers chose the social e-learning environment Edmodo because it contains many tools that the researchers think are appropriate for the process of training teachers socially, and they also chose the personal E-learning environment WordPress, which is a personal blog contains many tools which help the trainees to organize their own learning, and here the illustration of the most important characteristics of these two environments:

The researchers used the social E-learning environment Edmodo due to its many features, options, and characteristics that the researchers employed with the study group that used this environment in the training process, as follows:

The researchers also used the personal E-learning environment WordPress that relies on creating a personal blog and appropriately organizing its contents suits his /her perspective about training skills. The blog provides many options that allow the personalization of the trainees’ pages and articles. WordPress features summarization as a personal E-learning environment as following:

5.1.2. Second question’s answer

The second question introduced as follows: “What are the skills of designing E-tivities based on gamification needed to improve among technology teachers?”

The researchers relied on the Salmon concept of e-activity in the current study, as it defines a clear and specific philosophy in building e-activity regardless of the nature of the tools used. Thus, it has a comprehensive concept that describes the nature of active learning via the Internet, the definition of E-tivities adopted in this study is: “frameworks for enabling active and participative online learning by individuals and groups” (Salmon, 2013: 5)

To answer this question, the researchers studied the theoretical literature to search for tools to design E-tivities, and prepare a list of skills, then tools were identified, and presented in a session of experts to come up with a list of tools and applications that they recommend to train teachers to develop their designing E-tivities skills based on gamification, the committee classified tools in 6 main domains. Then, the researchers prepared the observation design skill card after identifying sub-skills from these tools and presented them to another group of arbitrators to be initially ready for applying on the pilot study to verify its reliability and validity. After the application of the procedures, the observation design skills card for designing E-tivities skills based on gamification is ready for use in the study, and it consisted of 6 main areas under which 96 indicators or skills fall, and these skills can be summarized as follows:

5.1.2.1. Salmon online active learning model

The researchers relied on the teacher training to design E-tivities skills based on gamification in an organized way using the Salmon Model for Active Learning via the internet, which consists of five stages. (Salmon, 2020), as presented in her book, considered “E-moderating as the key to teaching and learning online” in its third edition, as shown in the Figure 2 (Salmon, 2013).

Salmon (2002) illustrates these stages as follows:

5.1.3. The third question’s answer

The third question is introduced as follows: “Are there statistically significant differences at (α ≤ 0.05) between mean scores of the teacher in the social experimental group Edmodo and the personal experimental group WordPress in the post-application of the observation design skills card of the designing skills of E-tivities based on gamification?”

To answer this question, the researchers tested the following null hypotheses:

There are no statistically significant differences at (α ≤ 0.05) between mean scores of the teacher in the social experimental group Edmodo and the personal experimental group WordPress in the post-application of the observation design skills card of designing E-tivities skills based on gamification.

T-test for two independent samples is used to answer this question, to find the significant differences between mean scores of the two study groups in the post-application of the observation design skills card of designing E-tivities skills based on gamification, which is shown in Table 7.

The Table 7 shows that there are no statistically significant differences between the two experimental groups in the post-application of the observation design skills card of the designing E-tivities skills based on gamification in both different learning environments, the sig value ranged from (0.465) to (0.970) in the areas of skills of designing E-tivities based on the gamification of the observation card, and the sig value of the total skills reached (0.768), and all of these values are not statistically significant, which made the researchers accept the null hypothesis, with no statistically significant differences at the level of (α ≤ 0.05) between the mean scores of the teachers in the social experimental Edmodo group, and the personal experimental WordPress group in the post-application of the observation card due to the different E-learning environment.

5.1.4. Fourth question’s answer

The fourth question is introduced as follows: “Are there statistically significant differences at (α ≤ 0.05) level between mean scores of the teachers in the social experimental group Edmodo in the pre/ post-application of the observation design skills card of the designing E-tivities skills based on gamification?”

To answer this question, the researchers tested the following null- hypotheses:

There are no statistically significant differences at (α ≤ 0.05) level between mean scores of the teachers in the social experimental group Edmodo in the pre/ post-application of the observation design skills card of the designing E-tivities skills based on gamification.

The researchers used T-test for two dependent samples to answer this question to infer the significance of the differences between mean scores of the social E-learning environment group Edmodo in the pre and post-application of observation card of designing E-tivities skills based on gamification and the Table 8 shows that.

It is clear from the previous table that there are statistically significant differences at the level of (0.01) between mean scores of the teachers in the E-learning social group Edmodo, in the pre and post-application of the observation design skills card, in favor of the post-application in each skill separately, and in the general total score.

The researchers have calculated the effect size of the E-learning environment on developing the design skills of E-tivities skills based on gamification in the observation design skills card, Etta square (η²) is used to compare the pre and post results of the observation design skills card. It is clear from the previous table that there is a significant impact of E-learning social environment Edmodo on developing designing E-tivities skills based on gamification in the observation design skills card, for the following domains: Video Platform, Edublogs, Learning Management System Canvas, Spark Graphic Design Editor and Coggle, and Gamification Skills, where the value of the Etta square (η²) ranges between (0.829) to (0.964) in those domains, and it is noticeable that the effect size is medium in the domain of Google Drive cloud computing applications where it reached (0.595), and the researchers explain that the study sample is a teachers of technology and they have previous experience about some of the skills that used in this study, but in total, the effect size in all of these domains reached (0.964) and this indicates that there is a significant effect of the social E-learning environment Edmodo on developing the skills of designing E-tivities skills based on gamification.

5.1.5. Fifth question answer

The fifth question introduced as following: “Are there statistically significant differences at (α ≤ 0.05) level between mean scores of the teachers in the personal experimental group WordPress in the pre/ post-application of the observation design skills card of the designing E-tivities skills based on gamification?”

To answer this question, the researchers tested the following null- hypotheses:

There are no statistically significant differences at (α ≤ 0.05) level between mean scores of the teachers in the personal experimental group WordPress in the pre/ post-application of the observation design skills card of the designing skills of E-tivities based on gamification.

The researchers used T-test for two independent samples to compare the differences between the mean scores of personal E-learning environment group WordPress in the pre/post-application of the observation design skills card for designing E-tivities skills based on gamification (see Table 9).

It is clear from the Table 9 that there are statistically significant differences at (α ≤ 0.01) level between mean scores of the teachers in the personal experimental group WordPress in the pre / post-application of the observation card, In the favor of post-application for each skill and the total scores of skills.

The researchers calculated the effect size of the E-learning environment on developing the designing E-tivities skills based on gamification in the observation design skills card, they used Etta square to compare the pre and post results of the observation design skills card. It was clear from the previous table that there is a significant impact of personal E-learning environment WordPress on developing designing E-tivities skills based on gamification in the observation design skills card, for the following domains: Video Platforms, Edublogs, Learning Management System Canvas, Spark Graphic Design Editor and Coggle, and Gamification Skills, Etta square (η²) value ranges between (0.812) to (0.960) in those domains, and it is noticeable that the effect size is medium in the domain of Google Drive cloud computing applications where it reached (0.625) as is the case in the group of social learning environment Edmodo, the researchers explain that the study sample are technology teachers and have previous experience about some of the skills that used in this study, but in total, the effect size in all of these domains reached (0.971) and this indicates that there is a significant effect of the personal E-learning environment WordPress on developing the skills of designing E-tivities based on gamification.

To answer this question: “What is the effectiveness of E-learning environments on developing designing E-tivities skills based on gamification for technology teachers in Gaza?”

The researchers calculated the Black modified gain ratio, the following table shows the adjusted Black ratio gain for the post-application of observation design skills card compared to the pre-application of observation design skills card for each group as follows:

From the Table 10, it is clear that there is effective for both social E-learning environments Edmodo and the personal E-learning environment WordPress on developing designing E-tivities skills based on gamification, Black modified gain ratio reached the value (1.2), Black considers this result as the borderline of effectiveness in the using the program.

6. Recommendations

In light of global pandemic coronavirus COVID-19, teachers ‘skills in using e-learning tools for instruction are challenging. The distance learning became a vital requirement in the current situation, because of the big variety of options in E-learning environments available via the Internet, the current study aimed to know the effectiveness of E-learning environments on Designing E-tivities skills based on gamification on technology teachers in Gaza, and develop teachers’ skills in designing E-tivities based on active learning via the Internet, to stimulate students learning and become more e-learners.

In the same concern, it is clear that there is great effectiveness of both educational environments used in this study. They are social E-learning environment Edmodo, and personal E-learning environment WordPress on the development designing E-tivities skills based on gamification on the study sample, Both environments have contributed very closely to developing the teachers’ skills compared to their skills prior to the experiment. The results showed that there are no statistically significant differences between the mean scores of the teachers between the two experimental groups. The researchers clarify that this is due to the importance of these two learning environments and that they focus on different aspects of the learners, and neither of them replaces the other, and this is supported by the results of several studies that dealt with the feasibility and usefulness of social e-learning environments as the study of (Altunkaya and Ayrancı, 2020), and (Tamrin and Basri, 2020) study on developing cognitive and performance skills, as well as what was indicated by the study of (El-feky, 2019) which emphasized the role of the personal learning environment on developing those skills. With this result, this study highlights the appropriate use of social and personal E-learning environments in the training and learning processes, the teachers’ designing E-tivities skills based on gamification can be improved by using these learning environments. Thus, the researchers recommend that the great feasibility and usefulness of these environments are necessary for organizing and displaying information and facilitating communication and interaction among both parties of the educational process.

7. References

Adams, S. (2019). The Role of Gamification in the Facilitation of Student Engagement: An Exploratory Industrial Psychology Application. Stellenbosch University. Retrieved from: http://hdl.handle.net/10019.1/106010

Al-Dosari, F. (2018). The Extent of Employment of Social Studies Teachers for E-activities at the Intermediate and Secondary Levels in the Kingdom of Saudi Arabia and their Satisfaction with Them. The Educational Journal, 53, 290–326.

Al-Dowayan, M., & Mustafa, A. (2019). The Effect of the Difference in the Pattern of Electronic Training (simultaneous - asynchronous) on Developing some Skills in Designing Electronic Tests for Secondary School Teachers. El-Qiraa’ & El-Maerifa Journal, 151–215. Retrieved from: https://search.mandumah.com/Record/952594

Al-kandry, A. (2013). The Effectiveness of E-activities on Achievement and Motivation for Learning among a Sample of Kuwait University students. The Educational Journal, 28(109). Retrieved from: https://search.mandumah.com/Record/495379

Al-muqran, N. (2019). The Effect of E-learning Using the Edmodo Learning Management System on the Achievement of First-year Secondary Students in the Computer and Information Technology (1) Curriculum and Their Attitude Towards Technology. The International Journal of Specialized Education, 8(1), 118–136.

Al-shimmery, T. (2019). The Role of Digital Learning in the Professional Development of Teachers. The Arab Journal for Educational and Psychological Sciences, 7, 25–42.

Altunkaya, H., & Ayrancı, B. (2020). The Use of Edmodo in Academic Writing Education. Journal of Language Aggression and Conflict, 16(1), 89–103. https://doi.org/10.17263/jlls.712659

Baydas, O., & Cicek, M. (2019). The Examination of the Gamification Process in Undergraduate Education: A Scale Development Study. Technology, Pedagogy and Education, 28(3), 269–285. https://doi.org/10.1080/1475939X.2019.1580609

Benhadj, Y., El Messaoudi, M., & Nfissi, A. (2019). Artificial Intelligence In Education: Integrating Serious Gaming into the Language Class Classdojo Technology for Classroom Behavioral Management. IAES International Journal of Artificial Intelligence (IJ-AI), 8(4), 382–390. https://doi.org/10.11591/ijai.v8.i4.pp382-390

Cordero-Brito, S., & Mena, J. J. (2020). Gamification and Its Application in the Social Environment: A Tool for Shaping Behaviour. Journal of Information Technology Research, 13(3), 58–79. https://doi.org/10.4018/JITR.2020070104

Daniel, S. J. (2020). Education and the COVID-19 pandemic. PROSPECTS, 49, 91–96. https://doi.org/10.1007/s11125-020-09464-3

Dempsey, M., Brennan, A., & O’Dea, M. (2018). Re-Boot Learning Providing An Eactivity Scaffold for Engagement for Early Research Activity Through Blog Technology Embedded Within Teaching and Learning. The 12th Annual Technology, Education and Development Conference. Valencia, Spain. https://doi.org/10.21125/inted.2018.1648

Deterding, S., Dixon, D., Khaled, R., & Nacke, L. (2011). From Game Design Elements to Gamification. In Proceedings of the 15th International Academic MindTrek Conference on Envisioning Future Media Environments (pp. 9–11). MindTrek ’11. https://doi.org/10.1145/2181037.2181040

El-feky, M. (2019). The Effect of Personal Learning Environments on Participants’ Higher-order Thinking Skills and Satisfaction. Innovations in Education and Teaching International, 56(4). https://doi.org/10.1080/14703297.2018.1534601

El-Tabakh, H., & Ismail, A. (2019). The Interaction between the Adaptive and Participatory Digital Game Stimuli Pattern and the Type of Immediate and Postponed Feedback and its Effect on Developing Programming and Engaging Skills for Educational Technology Students. Arab Studies in Education and Psychology. Association of Arab Educators, 108, 60–132. https://doi.org/10.21608/saep.2019.49424

Fardoun, H., González-González, C. S., Collazos, C. A., & Yousef, M. (2020). Exploratory Study in Iberoamerica on the Teaching-Learning Process and Assessment Proposal in the Pandemic Times. Education in the Knowledge Society, 21, 17. https://doi.org/10.14201/eks.23537

García-Peñalvo, F. J., & Corell, A. (2020). The CoVId-19: The Enzyme of the Digital Transformation of Teaching or the Reflection of a Methodological and Competence Crisis in Higher Education? Campus Virtuales, 9(2), 83–98.

Gros, B., & García-Peñalvo, F. J. (2016). Future Trends in the Design Strategies and Technological Affordances of e-learning. In M. Spector, B. B. Lockee, & M. D. Childress (Eds.), Learning, Design, and Technology. An International Compendium of Theory, Research, Practice, and Policy (pp. 1–23). Switzerland: Springer International Publishing. https://doi.org/10.1007/978-3-319-17727-4_67-1

Hernández-Ramos, J. P., & Belmonte, M. L. (2020). Assessment of the Use of Kahoot! in Face-to-Face and Virtual Higher Education. Education in the Knowledge Society, 21, 23. https://doi.org/10.14201/eks.22910

Ibn Al-Hadlaq, A. (2019). Entertainment Education a Suggested Scenario for the Use of Education in Gamification. El-Qiraa’& El-Maerifa Journal, 209, 314–340.

Ibrahim, W., Madi, A., Al Arabi, Z., & Kamal, M. (2015). Building an Educational Environment Based on Social Webs and their Impact to Impove E-learning Development Skills. Second Conference: Qualitative Studies, Society Requirements and the Labor Market (pp. 101–156). Cairo: Faculty of Specific Education - Ain Shams University. Retrieved from: https://search.mandumah.com/Record/703315

Juhani, Z. (2018). The Impact of Gamification Learning Through Blackboard to Develop Problem-solving Skills in Mathematics for Gifted Female Students in the First Grade of Secondary School. Educational Scientific Research Journal, 19(11), 643–666.

Kapp, M. (2012). The Gamification of Learning and Instruction: Game-based Methods and Strategies for Training and Education. Wiley.

Kaur, P., & Naderajan, R. (2019, December). Kahoot! In the English language classroom. South East Asia Journal of Contemporary Business. Economics and Law, 20(6).

Ministry of Education & Higher Education. (2017). Education Department Strategic Plan 2017-2022 The Developed Version of the Third Strategy for Education. Ramallah: Ministry of Education & Higher Education. Retrieved from: https://bit.ly/3vwv50T

Palma, J., & Piteira, M. (2008). The Activities Value in e-learning. EUNIS 2008 VISION IT - Vision for IT in higher education. Aarhus: EUNIS. Retrieved from: https://www.eunis.org/eunis2008/papers/

Pettenati, M., & Cigognini, M. (2009). Designing e-tivities to Increase Learning-to-Learn Abilities. eLearning Papers. Retrieved from www.elearningpapers.eu

Pilař, L., Stanislavská, L., & Kuralová, K. (2020). Use of Gamification in Lectures Using the Kahoot! Tool. 17th International Conference Efficiency and Responsibility in Education. Prague. Retrieved from: https://erie.v2.czu.cz/en/r-16000-erie2020-e-posters

Pineda Hoyos, J. E., & Tamayo Cano, L. H. (2016). E-moderating and e-tivities: The Implementation of a Workshop to Develop Online Teaching Skills in In-Service Teachers. Profile Issues in Teachers’ Professional Development, 18(1), 97–114. https://doi.org/10.15446/profile.v18n1.44269

Prendes, P., Castañeda, L., Gutiérrez, I., & Sánchez, M. (2017). Personal Learning Environments in Future Professionals: Nor Natives or Residents, Just Survivors. International Journal of Information and Education Technology, 7(3). https://doi.org/10.18178/ijiet.2017.7.3.861

Remod, R. (2017). The Interaction between the Pattern of the E-learning Environment, the Individual Participatory Personality and the Independent, Accredited and Cognitive Style, and its Effect on the Development of Cognitive Achievement. Education Journal, 174(1), 12–100.

Robson, K., Plangger, K., Kietzmann, J., McCarthy, I., & Pitt, L. (2015). Is It All a Game? Understanding the Principles of Gamification. Business Horizons, 58(4), 411–420. https://doi.org/10.1016/j.bushor.2015.03.006

Rojas-López, A., Rincón-Flores, E. G., Mena, J. J., García-Peñalvo, F. J., & Ramírez-Montoya, M. S. (2019). Engagement in the Course of Programming in Higher Education Through the Use of Gamification. Universal Access in the Information Society, 18(3), 583–597. https://doi.org/10.1007/s10209-019-00680-z

Ruzmetova, M. (2018). Applying Gilly Salmon’s Five Stage Model for Designing Blended Courses. Dil ve Edebiyat Araştırmaları, 17, 271–290. https://doi.org/10.30767/diledeara.418085

Salmon, G. (2002). E-tivities: the Key to Active Only Learning. Turkish Online Journal of Distance Education-TOJDE, 4(1), 1–4. https://doi.org/10.1108/et.2003.00445fad.002

Salmon, G. (2013). E-tivities: The Key to Active Online Learning (2nd ed.). Routledge. https://doi.org/10.1108/et.2003.00445fad.002

Salmon, G. (2020). Five Stage Model. Retrieved from: https://bit.ly/3pZXMCs

Shane, M., Wisnudrajat, L., Wang, G., & Kaburuan, E. (2020). Implementing Gamification on a Web-Based Recruitment System Using Marczewski’s Gamification Framework: An Overview. International Journal of Advanced Trends in Computer Science and Engineering, 9(3), 2667–2672. https://doi.org/10.30534/ijatcse/2020/27932020

Slèvin, J. (2006). E-tivities and the Connecting of e-learning Experiences Through Deliberative Feedback. Tidsskrift for Universiteternes Efter- Og Videreuddannelse (UNEV), 4(9). https://doi.org/10.7146/unev.v4i9.4914

Sugito, T., Susilowati, S., Hartono, H., & Supartono, T. (2019). Integrating Edmodo Application in Science Teaching and Learning. Journal of Physics. Conference Series volume 1170 on page 012047. https://doi.org/10.1088/1742-6596/1170/1/012047

Tamrin, A., & Basri, B. (2020). Edmodo-Based Learning and the Students’ Perception. Eralingua. Journal Pendidikan Bahasa Asing dan Sastra, 4(1). https://doi.org/10.26858/eralingua.v4i1.11001

Tican, C., & Deniz, S. (2019). Pre-service Teachers’ Opinions about the Use of 21stCentury Learner and 21st Century Teacher Skills. European Journal of Educational Research, 8(1), 181–197. https://doi.org/10.12973/eu-jer.8.1.181

UNICEF. (2020). Framework For Reopening Schools. Retrieved from UNICEF: https://uni.cf/35uDVBT

Wright, P. (2014). “E-tivities from the Front Line”: A Community of Inquiry Case Study Analysis of Educators’ Blog Posts on the Topic of Designing and Delivering Online Learning. Education Sciences, 4(2), 172–192. https://doi.org/10.3390/educsci4020172

Žubrinić, K., & Kalpić, D. (2008). The Web as Personal Learning Environment. International Journal of Emerging Technologies in Learning (iJET), 3, 45–58.