Description
Consulting, ELT monitoring
Technologies
Snowflake, SQL, Sigma Computing
Problem
Certain sensitive tasks running as ELTs on Snowflake needed to be monitored, especially during the initial warm-up phase, so that necessary adjustments could be made promptly in the event of errors.
Solution
I created some workbooks in Sigma Computing to view any data that wasn't imported or modified correctly, and I set up a conditional scheduled export so that I would be notified only if a problem occurred.
In conclusion, Sigma's also very useful to monitor certain sensitive tasks on Snowflake, and conditional scheduling is perfect in these cases.