Information Generation and Navigation in Problem Based Training Systems

Christian Betz

Lehrstuhl für Informatik VI

Künstliche Intelligenz und Angewandte Informatik

Universität Würzburg

Phone: +49 931 888 6744

Fax: +49 931 888 6732

eMail: betz@informatik.uni-wuerzburg.de

April 17, 2000

Abstract

The training of diagnostic problem solving capabilities is the aim of many case based training systems, e.g. for medical students. They follow the approach of problem based learning. This faces the students with a problem exceeding their capabilities and thus induces an information need. This paper examines different ways of accomplishing this need by generating hypermedia documents and enabling intelligent access to static documents.

Keywords: problem based learning, intelligent tutoring systems, hypermedia,

student modelling

1 Introduction

The ability of diagnostic problem-solving functions as key qualification for domains like medicine, technical service or biology. Students can exercise this with the help of case-based tutoring systems. Hence such systems may be part of systematic learning environments. The problem based learning approach inverts the scenario: It faces the student with demanding problems. Solving the problem he needs to acquire new information. Within the learning process information seeking is a basic subtask. Several ways are possible for a student. First he may ask co-learners or tutors. Computer Supported Collaborative Learning (CSCL) utilize this approach for computer based training systems. Second print online media provide information. Finally intelligent tutoring systems (ITS) generate required explanations based on their domain model. The following analyzes the latter two approaches. After describing the learner’s information need a way to use the ITS’ domain knowledge to generate hypermedia documents is presented. Concluding we will show how to integrate given hypertext documents into intelligent tutoring systems. Some of the described methods have been implemented in D3Trainer which was developed at the University of Würzburg, department for Artificial Intelligence. D3Trainer is an ITS which is capable of problem solving, feedback generation and explanation. It is designed to teach diagnostic tasks in real world appliances. The Poliklinik of the University of Munich uses D3Trainer as RheumaTutor [6]. The proceeding will also be implemented in the coming Java-based version.

2 The D3Trainer and its applications

D3Trainer is an intelligent tutoring system environment based upon expert-system toolkit D3. It is designed to teach diagnostic problem solving in different domains and is practical tested. In a biological domain students learn to classify plants. The system provides the student with appearance of blooms, leaves and stock and other features for examination. For the medical domain RheumaTutor and other systems has prooven the practical use. They confronts the student with virtual patients. Any action any time is possible for the learner. The student can select examinations, enter findings and diagnosis and select therapies. Based upon problem-solving capability of the underlying expert-system D3Trainer is always able to criticize the students actions. It can automatically generate explanations for these reviews. Therefore, the expert will not have to enrich each case with tests and reviews. Thus adding new cases takes only a few minutes (about 20 minutes for the RheumaTutor, including pictures). Unfortunately the development for the underlying knowledge base is somewhat more costly. So this approach is efficient only when applied to a large or constantly growing numbers of cases. Usage of the RheumaTutor perfectly fits this model being used in the education of medical students at the University of Munich. The medical history of a real patient is taken in one lesson. During the following session on the next day the students have to work with the RheumaTutor showing the same case as virtual patient. This is possible with a short authoring process only. At the moment a second version of the web-based client of the D3Trainer is under development. Web access eases updates of system and case base. This is essential for the wide-spread usage. It will center even more upon problem-based learning than the current version. Hence, it needs support for information generation or retrieval, presentation and navigation.

3 Information Need

As mentioned above, problem based learning raises an information need. Acting in problem context students train problem solving instead of learning mere facts. The following considerations are specialized upon diagnostic problem solving. However, considerations in this section can easily be adopted to different tasks. Diagnostic problem solving divides into a set of subtasks: selecting examinations, interpretation of symptoms, signs and findings and derivation of diagnosis and therapies. Each step can face the student with an unknown situation. This provides a starting point for information seeking. An overview of the different types of questions a student might ask is given in the following list:

o Which examinations are reasonable?

o How should an examination be done?

o Which symptoms can be raised by an examination?

o Which list of diagnosis can be proven or confuted by a given examination

or a given set of symptoms?

o Which therapy should be chosen at the moment and why?

o What are the effects of a therapy?

A lot of these questions can be asked with different aspects in mind. Given a diagnosis, one can ask for the symptoms supporting it. On the other hand, the question could also ask for a diagnosis supported by a given set of symptoms. Thus it is important for the query to know the origin of a question as well as its target. Information need is not only characterized by the question itself. Different people need different documents when asking the same question due to their different preferences and prerequisites. Several types of preferences can be thought of. For example student A chooses to inform himself by reading encyclopedias while student B prefers to read textbooks. Students’ previous knowledge is another important aspect of information need. Those with deeper knowledge need in-depth documents. They may be provided a more holistic view of the domain or compact documents summarizing the facts.

4 Student modeling

Student modeling and the use of adaptive systems is one way to present well-suited information to the learner. The easiest way of modeling students uses stereotypes or a set of preferences. These are the modeling techniques used in the D3Trainer so far. To enhance the given features and implement new ones, a more sophisticated user profile is required. A history of the information the student already looked at establishes the basis for an overlay model. Atomic items in this model are learning targets rather than symptoms and diagnoses. This is necessary due to the large number of diagnoses in a real world application — the RheumaTutor for example uses about 180 diagnoses and even more symptoms. Using these as items in the overlay model would result in an almost empty model until the student treated a lot of virtual patients. This student model in addition to the context given by the actual case situation will be used to enhance both generation and navigation of hypermedia information.

5 Generating Hypermedia Information

The domain knowledge formulated to enable a problem-solving capability can also be used for generating hypermedia information [5]. Some of the questions a student could ask can be answered with these dynamic documents. As mentioned earlier, the system is able to criticize the students actions. It can tell whether the students selection of examinations is a good choice or a bad one. This information usually is not sufficient for the learner. He needs to know why a certain examination is not well-suited in the current situation. The D3Trainer is able to tell him the reasons, because it applied the knowledge to the situation in order to determine the feedback. It can do this by generating a hypermedia document showing e.g. all the currently known symptoms supporting or weakening a diagnosis. Hypertext links can then start at the symptoms and point to further informations. Hence feedback can be generated for the selection of dignosis and therapies. This feedback can also be explained with the technique shown.

6 Integration of Static Documents

Not only dynamically generated information can be used in the current D3Trainer. The knowledge modeled within the system can also be enriched by preformulated hypertexts. These can be filtered with respect to the casecontext and the student model. An example is the survey of the medical history in rheumatology. When asking for the kind of pain, one can not ask for special movement patterns. Instead it is reasonable to ask for simple task, which normally cause the pain to occur. Teaching the formulation of these questions is not part of the knowledge-base. Instead, this information is associated to certain knowledge-base items. Some other subjects can not be linked to any one item in the knowledge base. Not any domain is closed up to a degree high enough to gather all important information in the knowledge base. To integrate the information on the border of the model, informal documents are to be interlinked with the knowledge base. Risks and side effects of therapies are good examples for this kind of information. They might interact with different domains — especially in a domain like medicine. Since this information may not fit properly to the knowledge-base, it might be impossible to connect it to some few items. A dynamic intelligent search is much better suited for finding these documents than browsing might be. But only by a guided retrieval process the student can get support. General purpose search engines based e.g. upon keywords are no proper way, since the student might get lost in all the less relevant data. A search including the students situation and the context of the problem will be able to provide the right documents to the student. This will be integrated in the D3Trainer be the use of a information broker architecture. Documents become enriched by meta-information (following e.g. the Dublin Core, [2]), connecting them loosely to the knowledge-base. With respect to different formats like HTML, XML or PDF, proxy objects are included. Hence the broker can handle different kinds of documents, because it will not have to look inside. Only the viewer will have to deal with the document itself. The proxy architecture allows the broker to reference documents somewhere on the world wide web. The search will be processed by an knowledge based approach. Due to the small number of documents (compared to internet search engines), a knowledge base for selection of the documents can be build. The problem-solving components provided by D3 can be used to classify the documents with respect to the users information need. Both browsing and searching can profit from information filtering. As discussed above, the students prerequisites influence the utility of a document. Both documents with to low and to high knowledge level are not helpful for the student. Thus these documents have to be filtered out in the first answer. With respect to the possibility of a wrong student model, the hidden documents should be shown on demand.

7 Conclusion

So far, only basic information browsing and searching features exist in the current version of the D3Trainer. It is possible to browse hypermedia content to a certain degree and to search for information connected to knowledge base items. The web-environment however induces a demand for enhanced features. There might not be a human tutor guiding the search or assisting in case of questions. Hence the system has to provide this guidance. Other systems might also profit from the same concepts. Simulation based approaches inherently lack the explanation ability. One way to add this can be the approach presented above.

References

[1] De Vries, E. Educational multimedia for learning and problem solving,in Proc. European Conference on Artificial Intelligence in Education, Lisbon, Portugal, 1996

[2] Dublin Core Metadata Element Set, Version 1.1, 1999-07-02, http://purl.org/dc/documents/recdces-19990702.htm

[3] Greer, J. and Philip, T., Guided Navigation Through Hyperspace, in Proc. Workshop "Intelligent Educational Systems on the World Wide Web", 8th World Conference of the AIED Society, Kobe, Japan, 1997.

[4] Puppe, F., Gappa, U., Poeck. K. and Bamberger S., Wissensbasierte Diagnose- und Informationssysteme, Springer, 1996

[5] Reinhardt B.,Kritikoptionen in fallbasierten Trainingssystemen in Proc. GMDS-Workshop in Heidelberg on Computer Based Training, Heidelberg, Germany, 1999

[6] Schewe S., Reinhardt B., Betz C. Experiences with a Knowledge Based Tutoring System for Student Education in Rheumatology in Proc. 5th German Conference XPS 99, Knowledge Based Systems - Balance and Perspectives, Würzburg, Germany, 1999

[7] Turtle, H. and Croft, B., Infrerence Networks for Document Retrieval, in Readings in Information Retrieval, Karen Sparck Jones and Peter Willet (eds.), 1990