Building models with Pega machine learning

6 Tasks

15 mins

Pega Customer Decision Hub 8.8

Pega Customer Decision Hub '23 Pega Customer Decision Hub 8.7 Pega Customer Decision Hub 8.6 Pega Customer Decision Hub 8.5

Visible to: All users

Beginner Pega Customer Decision Hub 8.8 English

Scenario

U+ Bank implements Customer Decision Hub™ to determine which credit card offer to show a customer on the bank's website. To reduce the number of clients that leave the bank, the business wants to make use of the historical data that the bank has collected on customers that have churned in the past, so that they can predict which customers are likely to leave the bank soon. The bank wants to show retention offers to the potential churners, instead of credit card offers.

As a data scientist, your task is to create a predictive model that predicts churn. You decide to create the model by using Pega machine learning.

Use the following credentials to log in to the exercise system:

Role	User name	Password
Data Scientist	DataScientist	rules

Your assignment consists of the following tasks:

Task 1: Create a new predictive model

Create a new predictive model, ChurnPML, by using the Churn Modeling template in the Retention category.

Task 2: Prepare the data

Load the data set by using the CustomerData.zip file. Set the type of predictors that have no predictive power, such as CustomerID, to Not used. Create a uniform sample that uses 100% of the data. Retain 20% for the test set and 20% for the validation set. In the Outcome definition, use a Binary outcome type and Outcome as the outcome field. Map the values of the outcome field to the outcome categories.

Task 3: Analyze the data

Examine the trends exhibited by the best-performing predictors. Create a virtual field by combining several numerical predictors, and then examine the trend exhibited by this new predictor.

Task 4: Develop predictive models

For predictor grouping, use the best predictor of each group. Create a new bivariate model.

Task 5: Analyze the models

Compare the scores of the three models. Pay particular attention to Discrimination.

Task 6: Select model

Select the Regression model. Ensure that all predictors are mapped to customer properties. Reclassify the classes into a loyal class and a churned class. Save the model.

 

You must initiate your own Pega instance to complete this Challenge.

Initialization may take up to 5 minutes so please be patient.

• Log In

Challenge Walkthrough

Detailed Tasks

1 Create a predictive model

1. On the exercise system landing page, click Pega CRM suite to log in to Customer Decision Hub.
2. Log in as a data scientist:
   1. In the User name field, enter DataScientist
   2. In the Password field, enter rules.
3. In the navigation pane on the left, click Intelligence > Prediction Studio.
4. In the navigation pane of Prediction Studio, click Models to open the models work area.
5. In the upper-right corner, click New > Predictive model.
6. In the New predictive model dialog box, in the Name field, enter ChurnPML.
7. In the Category list, select Retention.
8. In the Template list, select Churn Modeling.
   
9. Click Start to proceed to the data preparation step.

2 Prepare the data

1. Download and extract the CustomerData.csv file.
2. In the Source selection section, click Choose File, and then select the CustomerData.csv file.
3. Check the data, and then click Next to proceed to the sample construction step.
4. In the CustomerID field, change the type to Not used.
   
5. In the Hold-out sets section, retain 20% for validation and 20% for testing.
   
6. Click Next to proceed to the outcome definition step.
7. In the Outcome definition section, in the Outcome type list, confirm that Binary is selected.
8. In the Outcome field to predict list, select Outcome.
9. In the Churn row, in the Outcome category column, select churned.
10. In the Loyal row, in the Outcome category column, select loyal.
    
11. Confirm that the number of cases in the development, validation, and test sets are approximately equal for both outcome categories.
    
12. Click Next to proceed to the data analysis step.

3 Analyze the data

1. In the list of predictors, click CreditScore and examine the grouping for this predictor.
   
2. In the upper-right corner, click Cancel to close the predictor report.
3. Click New virtual field to open the Virtual field dialog box.
4. In the Virtual field dialog box, in the Name field, enter DebtToIncomeRatio*Age.
5. Click Fields, select DebtToIncomeRatio, click Insert, and then enter *.
6. Click Fields, select Age, and then click Insert.
7. Complete the expression to read DebtToIncomeRatio * Age.
8. Click Save & close.
9. Confirm that the newly created predictor outperforms the two original predictors in the validation.
   
10. Click Next to proceed to the model development step.

4 Develop predictive models

1. In the Predictor grouping section, select Use best of each group.
   
2. Click Next to proceed to the model creation step.
3. In the Model creation section, in the Create model list, select Bivariate.
   
4. In the upper-right corner, click Submit to add the model to the model list.
5. Click Next to proceed to the model analysis step.

5 Analyze the models

1. On the Score comparison page, ensure that all the model checkboxes are selected.
2. Click Analyze charts to access the model analysis.
3. On the Discrimination tab, examine the results.
   
   Note: The regression model outperforms the decision tree model and the bivariate model as it has the largest area under the curve (AUC). However, before you choose a model, consider the number of predictors required by the model. Under certain circumstances, you might decide to select a predicting model that is lower performing but has fewer predictors.

4. In the upper-left corner, click the arrow next to Model analysis charts to return to the Score comparison page.
   
5. Click Next. On this page, you can analyze the score distribution.
6. Click Next. On this page, you can analyze class comparison.
7. Click Next to proceed to the model selection step.

6 Select the model

1. In the Model selection section, ensure that the Regression model is selected.
2. In the Save model section, in the Apply to field, enter UBank-CDH-Data-Customer.
   
3. Click Finish to select the model.
4. On the Model tab, in the Expected score distribution section, click the area between Result9 and Result10 in the score distribution chart.
   
5. In the Classification groups section, in the class 1-9 row, in the Name column, enter loyal.
6. In the Class 10-11 row, in the Name column, enter churned.
   
7. On the Mapping tab, ensure that all predictors are mapped to the appropriate customer fields.
8. In the upper-right corner, click Save.

Confirm your work

1. In the upper-right corner, click Run to test the predictive model.
2. In the Run predictive model dialog box, in the Inputs section, select data transform Troy, a customer that is likely to churn, as the data source.
   
3. Click Run, and then in the Outputs section, certify that the result for Troy is churned.
   
4. Re-run the model with data transform Barbara, a customer that is expected to stay loyal, as the data source.
5. In the Outputs section, verify that the result for Barbara is loyal.
   

 

---

This Challenge is to practice what you learned in the following Modules:

• Creating predictions and predictive models v1
• Creating predictions and predictive models v2

---

Available in the following mission:

• AI for 1:1 Customer Engagement v2