IBM Watson™ Ideas

Welcome to the IBM Watson™ Ideas Portal

We welcome and appreciate your feedback on IBM Watson™ Products to help make them even better than they are today!

If you are looking for troubleshooting help or wondering how to use our products and services, please check the IBM Watson™ documentation. Please do not use the Ideas Portal for reporting bugs - we ask that you report bugs or issues with the product by contacting IBM support.

Before you submit an idea, please perform a search first as a similar idea may have already been reported in the portal.

If a related idea is not yet listed, please create a new idea and include with it a description which includes expected behavior as well as why having this feature would improve the service and how it would address your use case.

Tool to compare Ground Truth and Decoding Result

In order to improve the machine-learning model, we need to investigate how and what WKS did differently compared to the ground truth. Right now, we are taking screenshots for each documents' ground truth and decoding result and compare and find out which entities(words), relations were confusing.

There is Confusion Matrix and this gives us a hit on which entities and relations we should look into but in order to take actions on improving the model we need to see which words were confusing in what kind of sentences.

  • Guest
  • Jul 5 2018
  • Needs review
Why is it useful?
Who would benefit from this IDEA? Human Annotators, WKS model evaluation and analysis persona.
How should it work?
Idea Priority
Priority Justification
Customer Name
Submitting Organization
Submitter Tags
  • Attach files