What is the difference between stemming and lemmatization?

[fa icon="calendar'] Apr 5, 2021 4:35:03 PM / by Bitext posted in Machine Learning, NLP, Bitext, Natural Language, Text Analytics, Artificial Intelligence, Deep Learning, Chatbots, Stemming, AI, Multilanguage, Lemmatization, NLP for Core, NLP for Chatbots, Conversational AI

[fa icon="comment"] 4 Comments

When we are running a search, we want to find relevant results not only for the exact expression we typed on the search bar, but also for the other possible forms of the words we used. For example, it’s very likely we will want to see results containing the form “skirt” if we have typed “skirts” in the search bar.

Read More [fa icon="long-arrow-right"]

Natural Language Understanding (NLU) for Audio Requires a Highly Accurate and Fast Speech to Text Foundation

[fa icon="calendar'] Mar 31, 2021 6:44:06 PM / by Bitext and Deepgram posted in NLP, Artificial Intelligence, Chatbots, NLU, AI, Multilanguage, NLP for Chatbots, IVR, voicebots, improvement of NLU models, ASR, Deepogram

[fa icon="comment"] 0 Comments

As companies consider adding voicebots to their customer service, they are experiencing the same "Achilles’ heel" with NLU voicebots as they do with chatbots.These issues are the following (the fourth one only applies to voicebots):

Read More [fa icon="long-arrow-right"]

Why is Bitext's Text Generation Unique?

[fa icon="calendar'] Nov 16, 2020 7:15:12 PM / by Bitext posted in Machine Learning, NLP, Bitext, Natural Language, Artificial Intelligence, Deep Learning, Chatbots, NLG, Multilanguage

[fa icon="comment"] 0 Comments

 

Read More [fa icon="long-arrow-right"]

Noisy text is realistic text

[fa icon="calendar'] Feb 24, 2020 4:45:00 PM / by Bitext posted in API, Machine Learning, NLP, Big Data, Bitext, Deep Linguistic Analysis, Natural Language, Text Analytics, Artificial Intelligence, Deep Learning, NLG, NLU, Query Rewriting, AI, Multilanguage, NLP for Core, NLP for Chatbots, NLP for CX, "Multilingual synthetic data"

[fa icon="comment"] 0 Comments

One of the flaws of usual training data generation is that, when you ask somebody to manually create training data for you, they will make an effort to write these sentences correctly, following the spelling and punctuation norms of your language. Even if some errors appear, they will be minimal, because they are trying to do things right —this is, to provide “orthographically right” sentences.

Read More [fa icon="long-arrow-right"]

Linguistic Resources in +100 Languages & Variants

[fa icon="calendar'] Feb 11, 2020 2:55:24 PM / by Bitext posted in API, Machine Learning, NLP, Big Data, Bitext, Deep Linguistic Analysis, Natural Language, Text Analytics, Artificial Intelligence, Deep Learning, NLG, Stemming, NLU, AI, Multilanguage, Language Identification, Decompounding, Lemmatization, NLP for Core, Finance, Banking

[fa icon="comment"] 0 Comments

All Machine Learning (ML) engines that work with text can benefit from a solid linguistic background. If they are working in a multilingual environment, the need of a good lexicon (with forms, lemmas and attributes) is overwhelming. Even so, basic features such as Word Embeddings hugely improve when enriched with linguistic knowledge, and if this is not usually applied, is because of a lack of linguists working for ML companies.

Read More [fa icon="long-arrow-right"]

From the eCommerce problem to the chatbot solution: Part II

[fa icon="calendar'] Jan 30, 2020 4:44:17 PM / by Bitext posted in Machine Learning, NLP, Big Data, Bitext, Natural Language, Text Analytics, Artificial Intelligence, Deep Learning, Chatbots, NLG, NLU, AI, Multilanguage, NLP for Chatbots, Finance, Banking, "Multilingual synthetic data"

[fa icon="comment"] 0 Comments

A chatbot offers significant advantages: it allows your customer support to be omnichannel —i.e. customers will be able to approach you via written chat, voice chat, email, phone, etc.—; it will save you the costs of hiring many additional employees, while sparing you the need of training agents every time your product changes; your customers’ satisfaction will increase; finally, you will get more and more sales (because well-taken-care-of visitors tend to become loyal and regular customers).

Read More [fa icon="long-arrow-right"]

Subscribe Here!