IBM Watson™ Ideas

Welcome to the IBM Watson™ Ideas Portal

We welcome and appreciate your feedback on IBM Watson™ Products to help make them even better than they are today!

If you are looking for troubleshooting help or wondering how to use our products and services, please check the IBM Watson™ documentation. Please do not use the Ideas Portal for reporting bugs - we ask that you report bugs or issues with the product by contacting IBM support.

Before you submit an idea, please perform a search first as a similar idea may have already been reported in the portal.

If a related idea is not yet listed, please create a new idea and include with it a description which includes expected behavior as well as why having this feature would improve the service and how it would address your use case.

Allow for bulk testing of questions

During the construction or the improvement of a virtual assistant, we need to test its behavior thoroughly. It involves using a list of questions to check if the answers are consistent.

There's no native way in WA to import a large amount of question and get an output file containing all the answers (considering every dialog branches possible for every question).

This would be a usefull option.

  • Guest
  • Sep 26 2018
  • Future Consideration
Why is it useful?
Who would benefit from this IDEA? As a business analyst, I want to be able to test a list of questions via an imported file.
How should it work?
Idea Priority
Priority Justification
Customer Name
Submitting Organization
Submitter Tags
  • Attach files
  • Gail Burati commented
    November 26, 2018 14:27

    A related idea is creating regression tests simply by saving Try It Out sessions - not only the utterances but everything else we'd want to check (intent, entities, context variables, nodes visited) in a future test run against an altered workspace OR test environment (ie new tokenizer). We don't currently log Try It Out sessions so we'd need a way for the customer to indicate at the start that this session is potentially one they want to save as a regression test or some other solution (always store temporarily until Cleared or Try it Out panel closed?). Would be great if when customers were reviewing results, they could easily decide a failure was just new and improved behavior and click a button to replace the old with the new.

    If it is not obvious already, I feel quite strongly that this feature is key to enabling customers to leverage dialog features AND for reducing the length of support calls since customers will be able to narrow down quickly what the new behavior they are seeing is.

  • John Wright commented
    November 29, 2018 13:47

    I'm actually implementing this functionality in a custom tool I wrote for helping us to test Watson.