Zoho CRM ETL | API Data Extraction to Snowflake | Fluid Attacks Help

Zoho CRM ETL

This ETL process extracts data from the Zoho CRM api and sends it to the warehouse (Snowflake).

Notes
Note
Local execution and sending of jobs will require to setup your environment and have access to the prod_observes role and the CACHIX_AUTH_TOKEN  environment variable.

Architecture

  1. Prepare:

    2. The ETL request export data on batch jobs through the zoho API. It saves the job id on Snowflake for future retrieval. Job is triggered by an schedule; local execution can be done with:
    m . /observes/etl/zoho-crm/fluid

  1. Core:

    2. This is the core ETL process which downloads the results of the previously requested data.

    m . /observes/etl/zoho-crm/fluid/prepare
Idea
Tip
Have an idea to simplify our architecture or noticed docs that could use some love? Don't hesitate to open an issue or submit improvements.