Automatización de canalizaciones de datos en Snowflake
Emily Melhuish
Technical Curriculum Developer, Snowflake
Tablas dinámicas:

Streams y tasks:

Automatización declarativa del pipeline
SELECT — describes el resultado y Snowflake gestiona el refreshCREATE DYNAMIC TABLE logistics.delivery_summary
TARGET_LAG = '1 hour'
WAREHOUSE = harbr_wh
AS
SELECT region, COUNT(*) AS shipments,
AVG(delivery_days) AS avg_days
FROM logistics.shipments GROUP BY region;
El contrato de frescura entre tú y Snowflake
| Valor de TARGET_LAG | Efecto |
|---|---|
'5 minutes' |
La tabla nunca tiene más de 5 min de antigüedad; refrescos frecuentes |
'1 hour' |
Refresca menos; menor consumo de cómputo |
DOWNSTREAM |
Infiera el lag desde los dependientes; ideal para tablas encadenadas |
Refresh incremental
-- Apto para incremental:
SELECT region, COUNT(*) AS shipments
FROM logistics.shipments
GROUP BY region;
Refresh completo

DOWNSTREAM se ajusta a la siguiente tabla: evita refrescos de másTablas dinámicas: declarativas
-- Declara el resultado para Snowflake
CREATE DYNAMIC TABLE logistics.summary
TARGET_LAG = '1 hour'
WAREHOUSE = harbr_wh
AS SELECT region, COUNT(*)
FROM shipments
GROUP BY 1;
Streams + Tasks: imperativas
-- Tú controlas cada paso
CREATE TASK process_events
SCHEDULE = '5 MINUTE'
WHEN SYSTEM$STREAM_HAS_DATA
('events_stream')
AS CALL logistics.process_new_events();
SELECT name, state, refresh_start_time, refresh_end_time
FROM TABLE (
INFORMATION_SCHEMA.DYNAMIC_TABLE_REFRESH_HISTORY (
NAME_PREFIX => 'HARBR_DB.DELIVERY_SUMMARY.', ERROR_ONLY => TRUE
)
)
ORDER BY name, data_timestamp;
| NAME | TRIGGER | STATE | START | END |
|---|---|---|---|---|
| DELIVERY_SUMMARY | SCHEDULED | SUCCEEDED | 2026-03-01 05:00:00 | 2024-03-01 05:00:08 |
| DELIVERY_SUMMARY | SCHEDULED | FAILED | 2026-03-01 04:00:00 | 2024-03-01 04:00:03 |
Automatización de canalizaciones de datos en Snowflake