Scheduling

Set up the time at which the monitoring will start. Make sure you send all your predictions by that time. When the Superwise monitor scans your data, it will not consider predictions sent after that time.

Delay parameter

When would we typically use the monitoring delay?

Asynchronous data availability - Depending on your input data storage set up in your internal systems, data may become available for collection with delays. The monitoring delay parameter will help you ensure Superwise doesn’t scan your data until all data has arrived.

Delayed feedback - For model performance monitoring policies, you need to ensure that Superwise will not scan your data until labels arrive. Because labels are usually sent some time after the predictions (depending on the monitored task), the monitoring delay parameter will help you ensure that data is scanned only after all labels are sent.