Hi there!
Quick question with respect to packs_per_day and picks_per_day…
How often does the underlying system run to generate the packs_per_day and picks_per_day data? In other words, for example, is it the case that when a pick is created, the record gets generated almost instantly and is then available in the API (like a live stream), or is there a “refresh process” that runs on a schedule for those endpoints (like a batch process)?
All the best,
Colin
Hey @cschouten,
Thanks for reaching out!
Going to look into this one and get back to you.
Please let me know if you have any questions or concerns.
Best,
RayanP
Hey @cschouten,
Thanks for hanging in there!
I believe the record is generated almost instantly. I just tested in my test account using packs_per_day
, within the same minute as packing my order, I was able to return results using the query.
Please let me know if you have any questions or concerns.
Best,
RayanP
Thanks @sh-agent. Just to clarify, is this also the case for picks_per_day?
All the best,
Colin
@sh-agent Is picks_per_day also updated near instantly or does it run on a batch process?
Hey @cschouten,
Thanks for hanging in there!
I believe there is a slight delay in the picks_per_day
query, but not the packs_per_day
query.
Please let me know if you have any questions or concerns.
Best,
RayanP
Thanks @sh-agent! That’s interesting.
Do you know the precise delay? I ask because we’re building an incremental data pipeline, and I’d need to know the “start time” (or date_from) value to ensure I get all the records for a specific window of time.
For example, if I run a task to grab all picks_per_day between 11 AM and 12 PM—and some records aren’t available from the API until after that 12 PM timestamp, I’ll miss ingesting said records, creating gaps in our data warehouse.
All the best,
Colin
Hey @cschouten,
I’ll need a little bit of time to get an exact number from my tests. I’ll get back to you on this.
Please let me know if there’s anything I can do to assist in the meantime.
Best,
RayanP
Awesome! Thank you @sh-agent!
All the best,
Colin
1 Like
Any update on this @sh-agent?
All the best,
Colin