Analyzing the results of simulations using reports

This demo will show you how to run a simulation and output the results to a database table and view the results using out-of-the-box simulation reports.

U+, a retail bank, recently updated one of their engagement policy conditions. They would like to unit test their changes by running a distribution test to check that the overall distribution is within the desired ranges.

This is the Pega Customer Decision Hub™ portal. Navigate to the Simulations landing page to create a new Distribution test.

To create a simulation, select the top-level strategy on which you would like to run the simulation. Use the top-level next-best-action strategy, as this simulation pulls in data from all relevant actions and treatments.

Then, select the input population on which you want to execute the simulation.

Now, rename the simulation. This will help you identify specific simulation runs easily. Next, configure the output. Create a new output destination. Give the output destination a name. You want to write the output to a database table, so select the Database Table option. Once you configure a new output destination, all the underlying artifacts are created for you (including the database table with the output columns). At this stage, you can select multiple output destinations, either another database table, or a Visual Business Director data source. For now, just continue with the SimulationResults database table. 

When one or more output destinations is a database table, you need to select which reports you want to have available for each destination. Select the output database table, then the report category, and finally one or more reports. Note that there are several out-of-the-box reports available. A decisioning architect can extend this list to create new reports specific to the business’ needs. For now, just choose two of the standard reports: Action distribution and Action priority report.

Run the simulation test.

When the execution is complete, you can inspect the results of the simulation by opening the assigned reports. You can also add reports to a simulation once the run is complete to view the output written to the database. This Action distribution report shows the volume of the individual actions. That is, how many times each action would be displayed to the customers. In the table you can also see the total volume at the group and business issue levels.

In contrast, the Action distribution report you would see in an audience or decision funnel simulation is only the number of customers who qualify for an offer.

The Action priority report shows the average priority of each action. Here you can see that the RewardsPlusCard offer has the highest average priority, meaning the expectation is that this will be the best performing action. If an action has a low average priority, it may also be offered less frequently.

This demo has concluded. What did it show you?

- How to execute a distribution test simulation.

- How to output simulation results to a database table.

- How to assign out-of-the-box reports to the simulation output.