Quick question with respect to packs_per_day and picks_per_day…
How often does the underlying system run to generate the packs_per_day and picks_per_day data? In other words, for example, is it the case that when a pick is created, the record gets generated almost instantly and is then available in the API (like a live stream), or is there a “refresh process” that runs on a schedule for those endpoints (like a batch process)?
Do you know the precise delay? I ask because we’re building an incremental data pipeline, and I’d need to know the “start time” (or date_from) value to ensure I get all the records for a specific window of time.
For example, if I run a task to grab all picks_per_day between 11 AM and 12 PM—and some records aren’t available from the API until after that 12 PM timestamp, I’ll miss ingesting said records, creating gaps in our data warehouse.