Archive for June, 2007

Machine Learning Based Semantic Inference: Experiments and Observations at RTE-3

Textual Entailment Recognition is a semantic inference task that is required in many natural language processing (NLP) applications. In this paper, we present our system for the third PASCAL recognizing textual entailment (RTE-3) challenge. The system is built on a machine learning framework with the following features derived by state-of-the-art NLP techniques: lexical semantic similarity (LSS), named entities (NE), dependent content word pairs (DEP), average distance (DIST), negation (NG), task (TK), and text length (LEN).

On the RTE-3 test dataset, our system achieves the accuracy of 0.64 and 0.6488 for the two official submissions, respectively. Experimental results show that LSS and NE are the most effective features. Further analyses indicate that a baseline dummy system can achieve accuracy 0.545 on the RTE-3 test dataset, which makes RTE-3 relatively easier than RTE-2 and RTE-1. In addition, we demonstrate with examples that the current Average Precision measure and its evaluation process need to be changed.

Read the paper:

Machine Learning Based Semantic Inference: Experiments and Observations at RTE-3

by Baoli Li, Joseph Irwin, Ernie Garcia, Ashwin Ram

Association for Computational Linguistics (ACL) Challenge Workshop on Textual Entailment and Paraphrase (WTEP-07), Prague, Czech Republic, June 2007
www.cc.gatech.edu/faculty/ashwin/papers/er-07-12.pdf

Domain Ontology Construction from Biomedical Text

NLM’s Unified Medical Language System (UMLS) is a very large ontology of biomedical and health data. In order to be used effectively for knowledge processing, it needs to be customized to a specific domain. In this paper, we present techniques to automatically discover domain-specific concepts, discover relationships between these concepts, build a context map from these relationships, link these domain concepts with the best-matching concept identifiers in UMLS using our context map and UMLS concept trees, and finally assign categories to the discovered relationships. This specific domain ontology of terms and relationships using evidential information can serve as a basis for applications in analysis, reasoning and discovery of new relationships. We have automatically built an ontology for the Nuclear Cardiology domain as a testbed for our techniques.

Read the paper:

Domain Ontology Construction from Biomedical Text

by Saurav Sahay, Baoli Li, Ernie Garcia, Eugene Agichtein, Ashwin Ram

International Conference on Artificial Intelligence (ICAI-07), Las Vegas, NV, June 2007
www.cc.gatech.edu/faculty/ashwin/papers/er-07-10.pdf

Emotionally Driven Natural Language Generation for Personality Rich Characters in Interactive Games

Natural Language Generation for personality rich characters represents one of the important directions for believable agents research. The typical approach to interactive NLG is to hand-author textual responses to different situations. In this paper we address NLG for interactive games. Specifically, we present a novel template-based system that provides two distinct advantages over existing systems. First, our system not only works for dialogue, but enables a character’s personality and emotional state to influence the feel of the utterance. Second, our templates are resuable across characters, thus decreasing the burden on the game author. We briefly describe our system and present results of a preliminary evaluation study.

Read the paper:

Emotionally Driven Natural Language Generation for Personality Rich Characters in Interactive Games

by Christina Strong, Kinshuk Mishra, Manish Mehta, Alistair Jones, Ashwin Ram

Third Conference on Artificial Intelligence for Interactive Digital Entertainment (AIIDE-07), Stanford, CA, June 2007
www.cc.gatech.edu/faculty/ashwin/papers/er-07-09.pdf

Evaluating Player Modeling for a Drama Manager Based Interactive Fiction

A growing research community is working towards employing drama management components in story-based games that guide the story towards specific narrative arcs depending on a particular player’s playing patterns. Intuitively, player modeling should be a key component for Drama Manager (DM) based approaches to succeed with human players.

In this paper, we report a particular implementation of the DM component connected to an interactive story game, Anchorhead, while specifically focusing on the player modeling component. We analyze results from our evaluation study and show that similarity in the trace of DM decisions in previous games can be used to predict interestingness of game events for the current player. Results from our current analysis indicate that the average time spent in performing player actions provides a strong distinction between players with varying degrees of gaming experience, thereby helping the DM to adapt its strategy based on this information.

Read the paper:

Evaluating Player Modeling for a Drama Manager Based Interactive Fiction

by Manu Sharma, Manish Mehta, Santi Ontañón, Ashwin Ram

Third Conference on Artificial Intelligence for Interactive Digital Entertainment (AIIDE-07), Workshop on Player Satisfaction, Stanford, CA, June 2007
www.cc.gatech.edu/faculty/ashwin/papers/er-07-08.pdf