Education/Projects/JetpackForLearning/Profiles/ClozeFox: Difference between revisions

From MozillaWiki
Jump to navigation Jump to search
No edit summary
 
(14 intermediate revisions by the same user not shown)
Line 1: Line 1:
== Description ==
== Short description ==


We propose a Firefox extension for language learning purposes which will generate fill-in and multiple choice exercises (cloze tests) from authentic pages on the Web. Any language learner worldwide will be able to turn any authentic text into an interactive exercise on the fly by clicking the ClozeFox Extension Button. Language teachers will be able to simply direct their students to a web page and students will have the authentic web page rendered as a fill in exercise thanks to this Firefox extension.
ClozeFox is a Firefox extension for language learning purposes which generates fill-in and multiple choice exercises (cloze tests) on-the-fly from authentic pages on the Web. A language learner can easily turn an online authentic text into an interactive, meaningful and useful exercise by using ClozeFox. ClozeFox will allow language teachers to direct their students to selected and suitable web pages that turn into tailor-made exercises.
 
Learning from the past, ClozeFox is a beautiful example of pedagogy-driven design as it responds to a huge need for interaction on authentic content '''without labor-intensive''' authoring. At the same time, it exploits affordances of Firefox extensions and related Web 2.0 tools for guaranteeing personalization, socialization, and scalability in terms of languages, parsing intelligence, exercise types, feedback, error analysis, remediation, and tracking & logging.
 
Language teachers worldwide are expected to encourage their students to use Mozilla Firefox in order to enrich their own learning environment with a powerful tool for autonomous and / or collaborative learning. Using ClozeFox, students will be able to exchange self-made exercises, store them in social collaborative repositories, moreover teachers can ask them to do so and monitor progress. ClozeFox can be seen as a first product in a series of tools for enhancing the (language) learning experience.


== INSTALL ==
== INSTALL ==
Basic installation and usage instructions are provided at [http://dev.linguapolis.be/jetpack/index.html ClozeFox Install page].
Please visit [http://dev.linguapolis.be/jetpack/index.html ClozeFox Install page] and click on the "Install..." button on the upper right corner of the page.
 
== Walkthrough ==
You can view and read a short and simple walkthrough [http://dev.linguapolis.be/jetpack/firstRun.html here]. This document contains short explanations and accompanying screen-shots from the current version of ClozeFox.
 
== Screencast ==
A short screencast is available [http://dev.linguapolis.be/jetpack/screencast/clozefox_screencast.htm here]. This is approximately a video version of the walkthrough above.
 
== Background and rationale ==
Since the early eighties, computers have been used extensively to offer a wide variety of exercises to language learners and teachers worldwide (see the [http://www.eurocall-languages.org/resources/history_of_call.pdf History of CALL]). Early MS-DOS programs started to appear in USA, UK and even in Belgium: Verbapuces, Vocapuces and Texta by DIDASCALIA (Jozef Colpaert & Wilfried Decoo, University of Antwerp, Belgium), and Adam and Eve (University of Leuven, Belgium). They offered the most advanced functionalities, rarely equaled or surpassed by contemporary web applications (see Colpaert 2004).
One of the most frequent exercise types has always been the cloze-exercise. A cloze exercise is a type of fill-in exercise which requires "the ability to understand context and vocabulary in order to identify the correct words or type of words that belong in the deleted passages of a text" ([http://en.wikipedia.org/wiki/Cloze_test Wikipedia]). Scientific literature from the eighties on (Bachman, Alderson, Bormuth, ...) quickly indicated some limitations of this activity type for accurate measuring in language testing, but it has been used very intensively ever since in learning systems and environments (Moodle, Dokeos, Blackboard, Hot Potatoes, Question Mark, ...). It is interesting to see that two Flemish universities have even developed their own interfaces for content authoring in learning environments: Entreposage Universel for Blackboard (Jozef Colpaert, University of Antwerp) and Curios for Dokeos (Ghent University).
 
Where initially language courseware (dedicated, meaning designed for language learning, teaching and testing) was the most successful application type, gradually tools (non-dedicated) have been taking over the leading position, both in terms of use as in terms of research and publications. An easy explanation of this phenomenon might be the impact of Web 2.0, but a more serious analysis reveals two important factors: the labor-intensiveness of content development and the labor-intensiveness of software development (Colpaert 2004).
 
The cloze exercise type remains a widely demanded, meaningful, useful and effective activity type. The impact of its deployment depends on the extent to which we can reduce the cost of content authoring (by reusing existing material, making it more generic and exchangeable, by researching new ways of generating content and questions from authentic materials in a computer assisted way, ...), and the cost of software development (by using appropriate design models, by reusing existing components and expertise, by working in open source, ...).
 
== Project objective ==
The objective of this project was to analyze to what extent Mozilla Firefox extension technology would allow us to create a tool for generating interactive exercises on-the-fly (or at least as quickly as possible). The project focused on discrete prototyping on some crucial issues identified on the basis of a broad pedagogy-driven design. This design started from the following requirements. Clozefox should:


== Progress Reports ==
* determine if a chosen web page contains enough text material;
Progress reports are available [http://ileriseviye.org/blog/?tag=jet4learning here].
* identify the language of a particular text;
* determine the difficulty level of a text;
* recognize the word categories (and later even semantic fields) in the text for adequate selection of relevant gaps;
* offer both fill-in, but also multiple choice exercises (with generated distractors);
* offer interaction scenarios and meaningful feedback;
* analyze errors and generate remedial exercises;
* store learner data and teacher preferences.


== Operation and Implementation Details ==
Teachers should be able to chose a relevant page and turn it into a rich and engaging exercise type, send it to their students or store it some repository. Learners should be able to choose their own text and generate their own exercises, but also retrieve exercises stored by their teachers. They will also be interested in seeing their results, in competing with other students and seeing an analysis of their progress.


ClozeFox first checks the page on the amount of usable and useful text, text structure and language ID based on page info or on trigrammes. It then makes a frequency list of the words in the text.
== Scalability ==
The scalability of ClozeFox can be described as follows:


The ClozeFox generator hides words on the basis of a routine with scalable intelligence: as a simple random routine would not be interesting from a linguistic-didactic point of view, ClozeFox will select gaps according to frequency level, word category, and later on semantic field, contrastive-linguistic aspect in order to turn the exercise into a rich learning experience.
* The number of languages depends on available frequency lists.
* The capacity for recognizing word categories, semantic fields and difficulty levels depends on the availability of frequency lists, and the information provided within.
* The selection of relevant and meaningful gaps depends on the intelligence of the parsing routine, meaning the capacity to recognize sentence structure.
* More intelligent didactic information can make interaction scenarios, feedback, diagnosis and remediation more powerful.
* The generation of multiple choice distractors can be made more intelligent.
* CloseFox activities can be linked to more Web 2.0 tools, social networks and electronic learning environments such as Moodle, Blackboard or Sakai.


ClozeFox generates fill-in exercises (for complete words or word-parts on morphological level such as word endings) and multiple-choice exercises (with other words in the text as generated distractors).


The ClozeFox options menu (with 'remembered' options) will include:
== Current status and further work ==
In its current status ClozeFox provides the following features:


* Number of gaps
* It can suggest web pages in English and Dutch, at simple or advanced levels. It does this by retrieving data from a [http://delicious.com/YAFZ/clozefox delicious account]. Thus it is possible to add new pages to the suggestion system by adding new URLs to that delicious account.
* Min/max length of gap
* It can create a random or preposition test on the given page.
* Per word category: nouns, prepositions, verbs …
* It can calculate the score and provide feedback for the correct and wrong answers.
* Exercise type: written (with option whole word / partial word) and multiple choice (with option number of distractors)
* It stores the information about previous test scores permanently. It can show these along with statistics and graphs on the slidebar.
* Time limitation
* It can delete previous score information if the user wants.
* Send exercise to ... (completed to show to parents/teachers what you have done as a learner; or 'empty' to send it as a teacher to your student or as a students to your co-students)
* It can send the current test's score to the user's Twitter account. Others can track this in real-time and can simply click on the page to do the same test.
* It can  copy the current test configuration. Thus, a teacher can simply compose an e-mail and press Control + v in order to share the test with teachers or colleagues. When that web address is sent ClozeFox automatically renders the web page as a cloze test without needing any input from the user. This makes sharing and running tests very easy.
* It can provide the definition of a selected word.


ClozeFox as an application is highly scalable on the following levels:
Of course in its current form the ClozeFox is far from perfect and needs further work:


* The complexity of the routine for selecting gaps.
* Better 'main text' detection routines in order to be able to handle various web pages.
* The intuitive intelligence of the system to adapt to the user based on learner behavior, performance and errors.
* More test types (for verbs, nouns, etc.).
* The possibility to add a refined morphological analyzer and parser later on.
* More control on the parameters of test (whole word, partial word, frequency of words to change).
* The possibility to ask for pronunciation (through sound synthesis) or translation of the word to fill in or any word in context.
* More intelligent control about distractors.
* Turn ClozeFox into a real collaborative Web 2.0 social exercise generator:
* The capability to play the pronunciation (through sound synthesis / or file retrieval) and / or translation of the word to fill in or any word in context.
** Students will become able to exchange self-made exercises, store them in social collaborative repositories, teachers can ask them to do so and monitor progress.
* A back-end web service so that much more sophisticated natural language processing routines can be handled for texts in various languages (such as the possibility to add a refined morphological analyzer and parser).  
** Language teachers worldwide are expected to encourage to use Mozilla Firefox in order to enrich their own learning environment with a powerful tool for autonomous and/or collaborative learning.
* User adaptability features: Again a back-end web service can store user's performance data and provide personalized suggestions and tests by performing statistical analysis of users and user groups, their behavior, performance and error characteristics.
* And finally refactoring of the current source code for easier development, should the other open source developers take an interest to add more features to ClozeFox.


ClozeFox can be seen as a first product in a series of tools for enhancing the (language) learning experience.


== Mockups ==
== Mockups ==


Please visit the [http://dev.linguapolis.be/jetpack/jetpack.html official description page] to see a few mockups. You may find the progress reports about development [http://ileriseviye.org/blog/?cat=64 here].
Please visit the [http://dev.linguapolis.be/jetpack/jetpack.html official description page] to see a few mockups.  
 
== Progress Reports ==
Progress reports are available [http://ileriseviye.org/blog/?tag=jet4learning here].
 
== Source code ==
Source code of ClozeFox is publicly available at [http://github.com/emres/clozefox its GitHub repository].


== About the team ==
== About the team ==

Latest revision as of 07:48, 6 February 2010

Short description

ClozeFox is a Firefox extension for language learning purposes which generates fill-in and multiple choice exercises (cloze tests) on-the-fly from authentic pages on the Web. A language learner can easily turn an online authentic text into an interactive, meaningful and useful exercise by using ClozeFox. ClozeFox will allow language teachers to direct their students to selected and suitable web pages that turn into tailor-made exercises.

Learning from the past, ClozeFox is a beautiful example of pedagogy-driven design as it responds to a huge need for interaction on authentic content without labor-intensive authoring. At the same time, it exploits affordances of Firefox extensions and related Web 2.0 tools for guaranteeing personalization, socialization, and scalability in terms of languages, parsing intelligence, exercise types, feedback, error analysis, remediation, and tracking & logging.

Language teachers worldwide are expected to encourage their students to use Mozilla Firefox in order to enrich their own learning environment with a powerful tool for autonomous and / or collaborative learning. Using ClozeFox, students will be able to exchange self-made exercises, store them in social collaborative repositories, moreover teachers can ask them to do so and monitor progress. ClozeFox can be seen as a first product in a series of tools for enhancing the (language) learning experience.

INSTALL

Please visit ClozeFox Install page and click on the "Install..." button on the upper right corner of the page.

Walkthrough

You can view and read a short and simple walkthrough here. This document contains short explanations and accompanying screen-shots from the current version of ClozeFox.

Screencast

A short screencast is available here. This is approximately a video version of the walkthrough above.

Background and rationale

Since the early eighties, computers have been used extensively to offer a wide variety of exercises to language learners and teachers worldwide (see the History of CALL). Early MS-DOS programs started to appear in USA, UK and even in Belgium: Verbapuces, Vocapuces and Texta by DIDASCALIA (Jozef Colpaert & Wilfried Decoo, University of Antwerp, Belgium), and Adam and Eve (University of Leuven, Belgium). They offered the most advanced functionalities, rarely equaled or surpassed by contemporary web applications (see Colpaert 2004).

One of the most frequent exercise types has always been the cloze-exercise. A cloze exercise is a type of fill-in exercise which requires "the ability to understand context and vocabulary in order to identify the correct words or type of words that belong in the deleted passages of a text" (Wikipedia). Scientific literature from the eighties on (Bachman, Alderson, Bormuth, ...) quickly indicated some limitations of this activity type for accurate measuring in language testing, but it has been used very intensively ever since in learning systems and environments (Moodle, Dokeos, Blackboard, Hot Potatoes, Question Mark, ...). It is interesting to see that two Flemish universities have even developed their own interfaces for content authoring in learning environments: Entreposage Universel for Blackboard (Jozef Colpaert, University of Antwerp) and Curios for Dokeos (Ghent University).

Where initially language courseware (dedicated, meaning designed for language learning, teaching and testing) was the most successful application type, gradually tools (non-dedicated) have been taking over the leading position, both in terms of use as in terms of research and publications. An easy explanation of this phenomenon might be the impact of Web 2.0, but a more serious analysis reveals two important factors: the labor-intensiveness of content development and the labor-intensiveness of software development (Colpaert 2004).

The cloze exercise type remains a widely demanded, meaningful, useful and effective activity type. The impact of its deployment depends on the extent to which we can reduce the cost of content authoring (by reusing existing material, making it more generic and exchangeable, by researching new ways of generating content and questions from authentic materials in a computer assisted way, ...), and the cost of software development (by using appropriate design models, by reusing existing components and expertise, by working in open source, ...).

Project objective

The objective of this project was to analyze to what extent Mozilla Firefox extension technology would allow us to create a tool for generating interactive exercises on-the-fly (or at least as quickly as possible). The project focused on discrete prototyping on some crucial issues identified on the basis of a broad pedagogy-driven design. This design started from the following requirements. Clozefox should:

  • determine if a chosen web page contains enough text material;
  • identify the language of a particular text;
  • determine the difficulty level of a text;
  • recognize the word categories (and later even semantic fields) in the text for adequate selection of relevant gaps;
  • offer both fill-in, but also multiple choice exercises (with generated distractors);
  • offer interaction scenarios and meaningful feedback;
  • analyze errors and generate remedial exercises;
  • store learner data and teacher preferences.

Teachers should be able to chose a relevant page and turn it into a rich and engaging exercise type, send it to their students or store it some repository. Learners should be able to choose their own text and generate their own exercises, but also retrieve exercises stored by their teachers. They will also be interested in seeing their results, in competing with other students and seeing an analysis of their progress.

Scalability

The scalability of ClozeFox can be described as follows:

  • The number of languages depends on available frequency lists.
  • The capacity for recognizing word categories, semantic fields and difficulty levels depends on the availability of frequency lists, and the information provided within.
  • The selection of relevant and meaningful gaps depends on the intelligence of the parsing routine, meaning the capacity to recognize sentence structure.
  • More intelligent didactic information can make interaction scenarios, feedback, diagnosis and remediation more powerful.
  • The generation of multiple choice distractors can be made more intelligent.
  • CloseFox activities can be linked to more Web 2.0 tools, social networks and electronic learning environments such as Moodle, Blackboard or Sakai.


Current status and further work

In its current status ClozeFox provides the following features:

  • It can suggest web pages in English and Dutch, at simple or advanced levels. It does this by retrieving data from a delicious account. Thus it is possible to add new pages to the suggestion system by adding new URLs to that delicious account.
  • It can create a random or preposition test on the given page.
  • It can calculate the score and provide feedback for the correct and wrong answers.
  • It stores the information about previous test scores permanently. It can show these along with statistics and graphs on the slidebar.
  • It can delete previous score information if the user wants.
  • It can send the current test's score to the user's Twitter account. Others can track this in real-time and can simply click on the page to do the same test.
  • It can copy the current test configuration. Thus, a teacher can simply compose an e-mail and press Control + v in order to share the test with teachers or colleagues. When that web address is sent ClozeFox automatically renders the web page as a cloze test without needing any input from the user. This makes sharing and running tests very easy.
  • It can provide the definition of a selected word.

Of course in its current form the ClozeFox is far from perfect and needs further work:

  • Better 'main text' detection routines in order to be able to handle various web pages.
  • More test types (for verbs, nouns, etc.).
  • More control on the parameters of test (whole word, partial word, frequency of words to change).
  • More intelligent control about distractors.
  • The capability to play the pronunciation (through sound synthesis / or file retrieval) and / or translation of the word to fill in or any word in context.
  • A back-end web service so that much more sophisticated natural language processing routines can be handled for texts in various languages (such as the possibility to add a refined morphological analyzer and parser).
  • User adaptability features: Again a back-end web service can store user's performance data and provide personalized suggestions and tests by performing statistical analysis of users and user groups, their behavior, performance and error characteristics.
  • And finally refactoring of the current source code for easier development, should the other open source developers take an interest to add more features to ClozeFox.


Mockups

Please visit the official description page to see a few mockups.

Progress Reports

Progress reports are available here.

Source code

Source code of ClozeFox is publicly available at its GitHub repository.

About the team

Prof. Dr. Jozef Colpaert is professor of Instructional Design and vice-chairman of the Institute for Education and Information Sciences (IOIW) at the University of Antwerp (Belgium). He is also director Research and Development at the Language Institute LINGUAPOLIS of the University of Antwerp, and editor-in-chief of Computer Assisted Language Learning, an International Journal (Taylor and Francis). For the last three years, he has been an active member of the executive committee of CALICO, the US organization for Computer Assisted Language Learning (CALL). He has been designing and developing CALL programs for the last 23 years and organizes the biennial International Antwerp CALL conferences (XIIIth edition). He is currently working on Distributed Language Learning, a methodological and conceptual framework for designing effective language learning environments and for determining the role of technology.

Emre Sevinc is an experienced software developer who designed and coded various web platforms for the last 10 years. Prior to joining the University of Antwerp in Belgium, he was involved with the design and development of the first online MBA e-learning system in Turkey. His current research areas are primarily computer aided language learning (CALL), natural language processing, and data mining. Previously he published scientific articles about e-learning, natural language processing, multi-agent systems, cognitive science and automatic recommendation systems. Besides his professional roles, he is also an open source developer who likes to create projects for machine learning, web programming and user task automation.

Linguapolis is the Language Institute of the University of Antwerp (Belgium). The institute (almost 100 teachers and researchers) organizes language courses and carries out R&D projects related to language learning, teaching and testing.

Retrieved from "https://wiki.allizom.org/index.php?title=Education/Projects/JetpackForLearning/Profiles/ClozeFox&oldid=200330"