Skip to main content

Challenge

Prioritizing actions using AI

4 Tasks

20 mins

Visible to all users
Beginner Pega Customer Decision Hub 8.6 English
This content has been updated. Click here to continue your progress on the latest version.

Scenario

When customers log in to the U+ Bank website, they see the credit card offers for which they qualify based on the engagement policy defined by business.

When customers qualify for multiple credit card offers, artificial intelligence (AI) decides which best offer to show.

The business understands how the Pega Customer Decision Hub™ AI works in the context of web channel. When a customer sees an offer, but doesn't click on it, the AI considers this as a negative behavior and lowers the propensity of the offer. When the customer clicks on the offer, the propensity is increased.

To complete the assignment, use the following credentials:

Role

User Name

Password

Decisioning Analyst

CDHAnalyst

rules

Caution: This challenge requires specific artifacts. Ensure that you click Initialize (Launch) Pega instance for this challenge to get the correct exercise system.

Your assignment consists of the following tasks:

Task 1: Enable propensity in arbitration.

In the Arbitration section of Next-Best-Action Designer, keep only the Propensity enabled to ensure that only AI is used in arbitration process to select the top action.

Task 2: Verify the negative behavior.

Successively log in to the U+ Bank website as Troy, but do not click the offer. Notice that after multiple logins, the propensity of an offer decreases when you do not click. Use the Interaction history report to examine the propensity value. Troy's subject ID is 14.

Note: The Priority value is used to prioritize actions and select the top action. Because you enabled only Propensity, the Priority is equal to Propensity. The negligible difference is due to the adjusted propensity, which is not in scope for this exercise.

Task 3: Verify the positive behavior.

Log back in multiple times and click an offer each time to record a positive behavior and to prove that the AI learns, and the propensity of the offer is increased for customers with a similar profile.

Note: The system decides when the actual learning happens. As a result, you might see some slight variations in the propensity and not a continuous increase after each click. However, multiple clicks lead to an increased propensity after a while.

Task 4: Examine the AI model.

Finally, in Pega Customer Decision Hub, examine the AI model behind the action / treatment.

Challenge Walkthrough

You must initiate your own Pega instance to complete this Challenge.

Initialization may take up to 5 minutes so please be patient.

Detailed Tasks

1 Enable propensity in arbitration

  1. Log in to Customer Decision Hub as Decisioning Analyst with User name CDHAnalyst using password rules
  2. From the navigation pane on the left, click Next-Best-Action > Designer.
    NBA designer
  3. In the Next-Best-Action Designer, click Arbitration.
  4. In the Arbitration landing page, click Edit to modify arbitration settings.
    Arbitration landing page
  5. In the Propensity section, ensure that the switch on the right is turned on.
    Enable propensity
  6. Scroll down to the Business levers section.
    turn off Business Levers
  7. To the right of Business levers, turn off the switch.
    save arbitration
  8. At the top of the Arbitration landing page, click Save to save the changes to arbitration settings so that only the propensity, calculated by AI, is involved in action arbitration

2 Verify the negative behavior.

  1. From the exercise system landing page, click U+ Bank to launch the U+ Bank website.
    Launch U bank
  2. In the U+ Bank website, in the upper-right corner, click Log in to log-in as a customer.
  3. In the Username drop-down list, ensure Troy is selected, and then click Sign in. An offer is displayed.
    Note: Do not click the offer. Each time you log out and then log in, Troy is presented with an offer but do not click on it.
  1. Perform successive logins without clicking the offer.
  2. In the Customer Decision Hub, click Interaction History > Recent interactions.
    Access interaction history
     
    access recent interactions
    Note: You can also see the propensity of actions previously made to a customer in the Recent interactions report. The subject ID for Troy is 14.
  1. Note how the impression is decreasing with every customer interaction.
    observe propensity values of troy
    Note: The values you see in your system vary depending on the number of times you log in to U+ Bank app.

3 Verify the positive behavior.

  1. After you have tested the effects of negative behavior, click on Learn more link below the offer. Do multiple logins and every time click on the Learn more. This will increase the propensity of the offer. Note after 3 logins and clicks on Learn more the propensity has increased in Interaction History.
    propensity positive values
    Note: The system decides when the actual learning happens. Therefore, you might see some slight variations in the propensity, and not a continuous increase after every single click. However multiple clicks will lead to an increased propensity after a while.

4 Examine the AI model

  1. Log-in to Customer Decision Hub portal as Decisioning Analyst.
  2. From the menu on the left, navigate to Intelligence -> Prediction Studio to view the AI models. This will open the Prediction Studio.
    Prediction studio from cdh
  3. Click Models to view the AI models.
  4. Scroll down, locate the Web_Click_Through_Rate and click to open the treatment level model.
    web click-through rate model
    Note: Analyzing the AI models in detail is beyond the current scope. For now, just examine the list of predictors and the outcomes already configured by a Data Scientist.
  1. The main monitoring screen shows an overview of all the models in a given channel:
    monitoring - web click-through rate
  2. You can see for e.g. that the best performing model is the Rewards Plus card, with a performance of around 88.01%. And that the model with the least responses, around 484, is the Rewards Card
  3. The Predictors tab contains the list of predictors configured at the time of creation this model. Not all of them may be used by the AI.
    predictors - web click-through rate
  4. The Outcomes tab contains the action outcomes mapped to positive and negative behaviors. Notice that Clicked is mapped to positive and NoResponse to negative.
    Outcomes - web click-through rate
  5. In the Monitor tab, open the Model Report for one of the models. For example, the Rewards Plus model:
    Predictors -web click-through rate
    Note: The actual view of the predictors can be different depending on the amount of clicks earlier. 
  6. In the Predictors tab, click on a predictor to open it. Examine the unique values or number ranges in the predictor and value or range with the highest propensity.
    Detailed predictor report
  7. At the top left, use the back button to navigate back.
    Back to predictors
  8. In the main Prediction Studio page, open and refresh the Omni_Adaptive_Model as well. This is the action level model.
    Omni Adaptive model
  9. At the bottom left corner, click Back to Customer Decision Hub to return to the Customer Decision Hub portal.
    Back to CDH
  10. From Content -> Actions, open any of the credit card actions. In the Details tab of the action, on the right, notice that a list of predictors used by the AI model is displayed. This AI model, OmniAdaptiveModel, is an action level model. This means that the model predicts the customer behavior not considering any particular treatment.
    Example for the Rewards Plus card:
    Customer predictors
  11. In the action, click on the Treatments to see the treatment level AI model
  12. Next to the web treatment, click on the Polaris icon to view the details of treatment level AI model.
    Polaris icon for rewards card
  13. The pop-up window gives you a snapshot of the treatment level AI model. You can see the current confidence level in predicting customer behavior and the predictors used to do the predictions.
    Analytical model report for rewards plus card

This Challenge is to practice what you learned in the following Module:


Available in the following missions:

If you are having problems with your training, please review the Pega Academy Support FAQs.

Did you find this content helpful?

Want to help us improve this content?

We'd prefer it if you saw us at our best.

Pega Academy has detected you are using a browser which may prevent you from experiencing the site as intended. To improve your experience, please update your browser.

Close Deprecation Notice