Load data
How to load data from your data sources into Squadbase DB on a schedule (ETL) with Automation
Automation can fetch data from your data sources on a schedule and load it into Squadbase DB (ETL). The data builds up inside your project, ready for dashboards and AI analysis.
Why load data
- Faster dashboards — dashboards read from loaded data instead of querying the data source every time
- Combine data sources — analyze data from your CRM, billing, ads, and other sources together in one place
- Keep history — keep daily values (stock levels, statuses, and so on) that the data source would otherwise overwrite
- Less load on data sources — loading happens once, at a set time
Asking for a data load
In the editor chat, say what to load and how often.
"Every night, load our Salesforce deal data."
"Load ad performance from January 2026 onward, one day at a time. Each day, add the previous day."
"Every morning, load stock levels and keep the daily history."
The AI creates the loading process (a pipeline), runs it once as a test, and confirms that the data arrives in Squadbase DB. You can also name the destination table in your request.
Loading data requires exactly one Squadbase DB connected to the project. For the source data sources, create a connection and make it available to the project first.
Choosing how to load
Saying how to load in your request makes the result predictable.
| How to load | Best for | Example request |
|---|---|---|
| Only what's new | Data that grows every day (orders, traffic, ad performance) | "Load it one day at a time, adding the previous day each day" |
| Update to the latest values | Data whose values change (customers, deals, product master) | "Keep each customer ID up to date" |
| Append as history | Data you want to track over time (stock levels, statuses) | "Append each day's values to keep the trend" |
When loading only what's new, dates already loaded are recorded, and the next run fetches only new dates. Runs get shorter, and credit usage goes down.
Following a load with more work
Loading data and the AI agent's analysis and notifications can run one after another in a single Automation. The next step starts only after the load finishes, so analysis always uses the latest data.
"Every night, load ad performance. The next morning, tell each owner which campaigns are spending off-plan."