Automazione delle pipeline di dati in Snowflake
Emily Melhuish
Technical Curriculum Developer, Snowflake
Tabelle dinamiche:

Stream e task:

Automazione dichiarativa della pipeline
SELECT — descrivi il risultato, Snowflake gestisce il refreshCREATE DYNAMIC TABLE logistics.delivery_summary
TARGET_LAG = '1 hour'
WAREHOUSE = harbr_wh
AS
SELECT region, COUNT(*) AS shipments,
AVG(delivery_days) AS avg_days
FROM logistics.shipments GROUP BY region;
Il contratto di freschezza tra te e Snowflake
| Valore TARGET_LAG | Effetto |
|---|---|
'5 minutes' |
La tabella non è mai più vecchia di 5 minuti: refresh frequenti |
'1 hour' |
Refresh meno frequenti: minor consumo di compute |
DOWNSTREAM |
Deduce il lag dai dipendenti downstream: ideale per catene |
Refresh incrementale
-- Adatto all’incrementale:
SELECT region, COUNT(*) AS shipments
FROM logistics.shipments
GROUP BY region;
Refresh completo

DOWNSTREAM segue le esigenze della tabella successiva: niente over-refreshTabelle dinamiche: dichiarative
-- Dichiara il risultato a Snowflake
CREATE DYNAMIC TABLE logistics.summary
TARGET_LAG = '1 hour'
WAREHOUSE = harbr_wh
AS SELECT region, COUNT(*)
FROM shipments
GROUP BY 1;
Stream + Task: imperative
-- Controlli ogni passo
CREATE TASK process_events
SCHEDULE = '5 MINUTE'
WHEN SYSTEM$STREAM_HAS_DATA
('events_stream')
AS CALL logistics.process_new_events();
SELECT name, state, refresh_start_time, refresh_end_time
FROM TABLE (
INFORMATION_SCHEMA.DYNAMIC_TABLE_REFRESH_HISTORY (
NAME_PREFIX => 'HARBR_DB.DELIVERY_SUMMARY.', ERROR_ONLY => TRUE
)
)
ORDER BY name, data_timestamp;
| NAME | TRIGGER | STATE | START | END |
|---|---|---|---|---|
| DELIVERY_SUMMARY | SCHEDULED | SUCCEEDED | 2026-03-01 05:00:00 | 2024-03-01 05:00:08 |
| DELIVERY_SUMMARY | SCHEDULED | FAILED | 2026-03-01 04:00:00 | 2024-03-01 04:00:03 |
Automazione delle pipeline di dati in Snowflake