Viewing Model Health

[#1]

This article describes the model overview screen and how to use the sparkline graph as a guideline to the ongoing health of a deployed model.

In this article:

Table of Contents Placeholder

Deployed Model Dashboard

The dashboard lists each deployed model as a tile. A tile contains a snapshot of the prediction results for that model. Click a tile to view the details of a that model. To access the dashboard view, go to Predict > Overview.

A tile may display the following information about a model:

• The status of a model, such as "In Training" or "Deployed", in the upper right corner of each tile. 
• The strength score rating of a model, such as "Fair" or "Excellent".
  

  Strength ratings are recalculated automatically and the sparkline graph reflects live performance metrics.

• A sparkline graph depicting the general performance trend of the model.
• The version of the deployed model.

Strength Score Ratings

In the dashboard view, the strength score displays in parentheses as a decimal number, such as (0.91). This number represents the F1 score that the rating is based on.

The strength rating cannot be known or calculated for a deployed model until the initial prediction timeframe has elapsed. For this reason, the strength rating of a model is not available until the day after the prediction timeframe. For example, if a model to predict the likelihood to purchase in the next 10 days is deployed on January 1st, the rating cannot be calculated until after January 10th.

Expanded View

Click a tile to display an expanded view of the model. In the expanded view, the sparkline graph shows the trend of the prediction ranges over time.

The prediction ranges are based on the following strength scores:

• Most Likely (0.76 - 1)
• More Likely (0.51 - 0.75)
• Less Likely (0.26 - 0.50)
• Least Likely (0 - 0.25)

Version Adaptation

The sparkline graph adapts to versioning. For example, if you first deploy "Version 1" and later undeploy "Version 1" and deploy "Version 2", the graph automatically switches from "Version 1" to "Version 2". The adaptive chart ensures that you see the strength of the output attribute for the latest deployed version of the model.

Additional Information

See the following articles for additional information about model scores and evaluation:

• Evaluating the Trained Version
• Deployed Model Health Scores