Using Smart Schedule
On this page
This guide explains how to use Smart Schedule, how it manages datastream dependencies, and how to apply it to multiple datastreams. To create a scheduled fetch first, see Fetching data.
Using Smart Schedule
Smart Schedule provides the following benefits:
-
Automatically fetches new data and refreshes existing data with appropriate attribution windows.
-
Respects datastream dependencies, waiting for prerequisite datastreams to update first.
-
Optimizes fetch timing while respecting API rate limits to minimize errors.
-
Takes the average processing time from recent successful runs for each datastream into account, starting longer fetches earlier so they complete on time.
-
Analyzes historical data to determine optimal fetch patterns.
-
Prioritizes fetches based on frequency (daily fetches take priority over weekly or monthly).
-
Supports up to four independent ranges per datastream, each with its own frequency and refresh window, so you can combine a frequent light-weight check with a less frequent wider refresh.
To enable Smart Schedule, follow these steps:
-
Go to the Datastreams page.
-
In the Fetch section, turn on the Scheduling switch.
As a result, the Set Smart Schedule dialog opens with two suggested ranges. Each suggested range is summarized in the format Every [frequency], fetch data from [range], load by [time] UTC. To use the suggested ranges as they are, click Set schedule.
To configure the ranges yourself, change one or more ranges in the Set Smart Schedule dialog using the following fields, then click Set schedule:
- Frequency
Select how often this range fetches data: Every day, Every week, Every 2 weeks, Every 4 weeks, or Every month. Each range must use a different frequency.
- Day of week / Day of month
For a weekly-based frequency, select the day of the week the fetch runs on. For a monthly-based frequency, select the day of the month (1st–28th).
- Fetch data from
Select the time range to refresh on each fetch. Smart Schedule automatically applies the recommended attribution window based on the connector, and only offers time ranges long enough to cover the selected frequency. For example:
Facebook Ads fetches by default every day yesterday and the last 6 days
Google Ads fetches by default every day yesterday and the last 29 days
TikTok Ads - last 28 days
LinkedIn Ads - last 30 days
File/Datalake, Database category - None
To add another range, click Add schedule, up to a maximum of 4 ranges. Add schedule is disabled once every available frequency is already used by an existing range, or once 4 ranges are configured. To remove a range, click Remove schedule next to it; you cannot remove the last remaining range.
- Load the data by (UTC)
Set a specific time (in UTC) by which you want the data to be loaded for this datastream. Setting a “load by” time prioritizes this datastream, significantly increasing the chances that the scheduled data is delivered by the selected time.
The default time used for all datastreams with Smart Schedule can be changed in the workspace admin settings.
- Earliest fetch start (UTC)
Set a specific time (in UTC) before which this datastream’s fetch will not be dispatched, even if it is otherwise due. Use this to keep fetches off a data source’s peak hours, or to line them up behind an upstream system’s nightly data load. Select No restriction to allow the fetch to start as soon as it is due.
The default time used for all datastreams with Smart Schedule can be changed in the workspace admin settings.
The Set Smart Schedule dialog draws the fetch window between the earliest start time and the Load the data by time, so you can see the gap between them at a glance.
How Smart Schedule manages datastream dependencies
When you enable Smart Schedule for datastreams that have dependencies, Smart Schedule automatically:
-
Identifies all direct dependencies between datastreams.
-
Ensures source datastreams are updated before dependent datastreams.
-
Checks that all required data ranges are available in source datastreams.
-
Triggers dependent datastream fetches only when all prerequisites are met.
This intelligent sequencing eliminates the need to manually coordinate fetch schedules between related datastreams, ensuring data consistency throughout your pipeline.
Applying Smart Schedule to multiple datastreams
To apply Smart Schedule to multiple datastreams at once, follow these steps:
-
Go to the Datastreams page.
-
Select the checkboxes next to the datastreams you want to schedule.
-
Click Schedule fetches.
-
Configure one or more ranges as described above.
-
Click Set schedule.
This feature eliminates the need to configure each datastream individually, saving significant time when managing multiple data sources.