Skip to main content

Best practices for using suggested cases

For success with Pega Voice AI™, focus on the Cases that account for the largest percentage of the Case Types for the customer minimum lovable product (MLP). As a best practice, build Case suggestions for 70 to 85 percent of the total Case volume. Voice AI use increases with higher numbers of accurate Case Type suggestions.

You can run the Case Volume report to identify the most-used Case Types.

Voice AI uses Pega natural language processing (NLP) to suggest Case Types. You can configure NLP in two ways:

  • Keyword-based configuration: The UI includes keyword-based configuration so that you can quickly create keywords and verify that Voice AI is working. Keywords work best with a definitive word set that applies to only a single Case Type. To configure keyword-based Case suggestions, you create a list of comma-separated words or phrases that trigger a suggestion for a Case.
  • Machine learning configuration: Voice AI performs Case suggestion best when you use a machine learning model. The model uses phrases or utterances in the Voice AI transcript to create alerts for the Case NLP topic. Machine learning is the recommended model. This process takes more effort to configure and requires continued maintenance, but it results in a more accurate set of Case suggestions.

You can use keyword-based suggestions and machine learning simultaneously, which can yield even more accurate results. You can configure a machine learning model that must contain certain keywords.

Keyword-based configuration for Case Type suggestion

Keyword-based suggestions are rudimentary; suggestions should apply only to Case Types where the CSRs utter the keywords for that specific interaction. Overlapping the keywords in a conversation for another Case Type can lead to an inaccurate Voice AI suggestion (false positive).

Apply the following methods to gather data and identify a list of words or phrases related to a Case Type:

  • Use subject matter knowledge: Existing subject matter expert knowledge can help you identify the keywords and phrases that trigger the Case selection. This method is not scientific and can result in many missing words and phrases in the interaction.
  • Review call recordings: A Business Architect can review call recordings that apply to each Case Type in which they try to identify the keywords. This method is a scientific approach, but it might be difficult to correlate the Case Types to interactions. Additionally, it is the most time extensive form of research.
  • Review messaging transcripts: If the customer is using Pega Digital Messaging, the transcripts for those conversations can provide insight into the keywords to use in the Case suggestions. Messaging conversations often have commonality with the speech found in a voice interaction.
  • Enable Voice AI to gather only transcripts: This research method takes longer than the typical product deployment but yields the most accurate results. As a best practice, enable Voice AI for several CSRs over a short period (two weeks) to do nothing but gather transcripts for review. Then, the system can create a report for phone interactions that handle specific Case Types. You can then review the transcripts for those interactions.

Using this approach can change the project plan, which requires prompt completion of the development and lower-level environment integration and the deployment of Voice AI to production. A transcript review step can occur after the go-live to identify the interactions that did not receive Case suggestions. Still, you use a Case Type to review the transcript for improvements.

Machine learning configuration for Case Type suggestion

To create a machine learning model, Voice AI requires a list of utterances that led to the Case suggestion. With Voice AI machine learning Case suggestions, you want to trigger what a CSR might hear that causes them to click Add Task and select a Case Type.

To populate the model, the customer can help define the Case Types by providing sample utterances from each type of participant in the call. For example, the following table contains samples for a health insurance member calling about various Case Types:

Case Type

Description

Utterance 1

Utterance 2

Utterance 3

Manage Claims

Health insurance member contacts Customer Service regarding a claims question.

Why is my claim denied?

Have you received my claim?

My doctor said my claim hasn't been paid.

Included Benefits

Health insurance member contacts Customer Service regarding their available benefits and programs.

How many physical therapy visits do I have?

Is my insulin covered?

What is my deductible?

Provider Lookup

Help the health insurance member find a new provider.

I need a new primary care physician.

Is my doctor in network?

Is there a dentist near me?

If NLP analysis is active for both the customer and the CSR, you also want to collect the utterances that a CSR makes that might lead to a Case suggestion, as shown in the following table:

Case Type

Description

Utterance 1

Utterance 2

Utterance 3

Manage Claims

CSR helps health insurance member with a claims question.

Do you have the claim number?

What is the date of service?

Your claim will be processed on July 17th.

Included Benefits

CSR provides information to health insurance member regarding their available benefits and programs.

Would you like information about our diabetes program?

You haven't used your dental benefit yet.

Do you want to verify that you have dental coverage as well?

Provider Lookup

Help the health insurance member find a new provider.

What kind of provider can I help you find?

Have you used the provider finder on the website or app?

Are you looking for a primary care physician or an internalist?

Sometimes, the conversation might include another "Persona" on the customer channel. For example, in health care, a customer service department might receive calls from health care members and health care providers. You can generate utterances that the other Persona might make, as shown in the following table:

Case Type

Description

Utterance 1

Utterance 2

Utterance 3

Manage Claims

Health care provider contacts CSR with a claims question.

We received a claim denial.

The claim hasn't been processed.

Have you received our claims?

Included Benefits

Healthcare provider contacts customer service regarding available benefits for members.

What is the patient's deductible?

Does the patient have behavioral health coverage?

How many physical therapy visits does the patient have per year?

Provider Lookup

Provider is validated by CSR.

Our office address is 123 Main St.

The provider's NPI is 7897533131

The doctor's specialty is cardiology.

You can use the Case Suggestion Feedback Form to gather information for implementing suggested Cases:

 

Generative AI use cases

You can also use generative AI to create additional suggested phrases. To generate additional utterances, you can issue requests to the generative AI engine; for example:

  • Provide 20 utterances for a health insurance member who inquires about the status of a claim.
  • Provide 20 utterances for a health insurance CSR who asks a member what type of health care provider they can help find.
  • Provide 20 utterances for a health care provider contacting a health insurer indicating the reason for their call was due to a claim denial.

You can add the utterances to a spreadsheet and then review them with the customer for validity. If the customer believes that a CSR might create a Case Type based on the spoken utterance, then it is a valid use case. You can add the utterance to the Case suggestion spreadsheet.

Note: Sometimes, generative AI creates utterances with more than one sentence. Typically, a generated utterance contains a greeting sentence such as "Good morning!" or a secondary sentence of "Can you help me with that?" Remove sentences that do not relate to the context of the Case Type.

Each topic needs at least 30 suggested utterances. The larger the volume of utterances, the better the model performs. In some Cases, you might want to include hundreds of phrases.

Updating the topic model

After you have generated the phrases and utterances, you use this data to train the topic model. You can use Prediction Studio to review and update your topic models. For example, for a topic named Manage claims, you will find a topic model for Manage claims in Prediction Studio. The Manage claims model may initially contain only the keywords associated with the topic. You can import your phrases/utterances into the model, then rebuild the model.

For information about importing the data and rebuilding a topic model, see Importing topics to text predictions.


This Topic is available in the following Module:

If you are having problems with your training, please review the Pega Academy Support FAQs.

Did you find this content helpful?

Want to help us improve this content?

We'd prefer it if you saw us at our best.

Pega Academy has detected you are using a browser which may prevent you from experiencing the site as intended. To improve your experience, please update your browser.

Close Deprecation Notice