When we are running a search, we want to find relevant results not only for the exact expression we typed on the search bar, but also for the other possible forms of the words we used. For example, it’s very likely we will want to see results containing the form “skirt” if we have typed “skirts” in the search bar.

Almost three years after Apple launched its well-known voice assistant Siri for the Arabic language, there is still room for further improvement. Siri can currently understand more than 20 languages and dialects; but, when it comes to Arabic, its abilities are not good enough to fully understand what users need. Several utterance errors together with poor understanding skills are quite frustrating for Arabic speakers. What’s going wrong here?

The Nvidia team/blog cannot be clearer about the challenges of AI & NLP: “Recent work has demonstrated that larger language models dramatically advance the state of the art in natural language processing (NLP) applications such as question-answering, dialog systems, summarization, and article completion. However, during training, large models do not fit in the available memory of a single accelerator, requiring model parallelism to split the parameters across multiple accelerators.” See details at "State-of-the-Art Language Modeling Using Megatron on the NVIDIA A100 GPU" https://devblogs.nvidia.com/language-modeling-using-megatron-a100-gpu