Sunday, June 15, 2008

Get the Factz right!

How well does Powerset get its Factz right?
  1. A cricketer's favourite query is Is Sachin God? Factz gets it right! :-). Of course, Sourav is not far behind ;-).

  2. A traditional set theory query of Is Null set a Sub set gives a Power Set response! This definitely is a conspiracy by Powerset ;-)

  3. Another query "Who killed Gandhi?" ...
    Factz from Wikipedia: we found that the following kill Gandhi
    madman, Nathuram Godse, Nathu Ram Godse and assassin
    Nathuram Godse He said, "No one should think that Gandhi was killed by a madman".

    The results also correctly include the assassinations of Rajiv Gandhi and Indira Gandhi.
    But Nathuram Godse did not intend "madman" to be listed as an assassin of Gandhiji!

I believe that in Semantic Retrieval it is important to handle "negation". It is non-trivial but very important as it modifies the semantics. "Negation" highlights the need to use NLP technologies in improving retrieval quality and "the intent" ...

Overall I'm impressed with the results of Powerset. It does get the Factz right ...


Mark Johnson said...

Cool queries! One of my favorite math queries of all time is: what sets are countably infinite?

Also, not that in Factz, Powerset shows results that are both positive and those that are negated, though we know the difference between the two when we parse a sentence. We show both in Factz because the negation is often just as interesting as the Factz.

rb stumped said...

Thanks Mark for the clarification.

I'm aware that Powerset has a very good NLP engine (XLE?). Would it be possible to highlight the negated ones in the results?

It would have added a "wow" factor if the output actually said "not madman". That would demonstrate the real power and the Powerset difference ...