IBM Watson™ Ideas

Welcome to the IBM Watson™ Ideas Portal

We welcome and appreciate your feedback on IBM Watson™ Products to help make them even better than they are today!

If you are looking for troubleshooting help or wondering how to use our products and services, please check the IBM Watson™ documentation. Please do not use the Ideas Portal for reporting bugs - we ask that you report bugs or issues with the product by contacting IBM support.

Before you submit an idea, please perform a search first as a similar idea may have already been reported in the portal.

If a related idea is not yet listed, please create a new idea and include with it a description which includes expected behavior as well as why having this feature would improve the service and how it would address your use case.

Allow user defined dictionary for Kuromoji tokenization use under Japanese

Requesting to allow users to define their list of user_dictionary words for the purpose of Kuromoji’s tokenizer.

I understand that WDS uses Kuromoji underneath for Japanese language. A key function of Kuromoji as the morphological analyzer for Japanese text is its ability to tokenize words (because in Japanese there is no spacing to signal separation between words like other languages such as in English). To ensure this capability works for a user’s domain Kuromoji comes with the ability to append a “user_dictionary” in addition to its default list, it is this capability that I am requesting be exposed for WDS users in Japanese.

This function is considered a necessity for Japanese large clients, including our current largest user of R&R at JR-East. The reason being, in many client’s call center support operations, including JR-East’s, they contain business terminology that’s unique to their business. These business terminology are words created from multiple nouns joined together (i.e compounds of multiple nouns). Whether these business terms are treated (tokenized) as a single compound and/or as multiple separate nouns, greatly impacts the accuracy of searches.

  • Oct 3 2017
  • Future Consideration
Why is it useful?
Who would benefit from this IDEA?
How should it work?
Idea Priority High
Priority Justification
Customer Name
Submitting Organization
Submitter Tags
  • Attach files