Flexible Data Integration
Full data connectors flexibility
It’s your data — and every data is different. You need flexible connectors to extract data from multiple sources and load it into your data warehouse to best realize your data analysis needs.
Different data sources support different ways of both specifying what data is to be extracted as well as how the data is to be extracted.
Datacoral and its flexible connectors support a wide variety of options that are easily composable for maximum flexibility in data integrations.
Databases
Capture changes from your databases and see up-to-date data in your warehouse
Application APIs
Sync data from dozens of application or write your own custom connector
Events
Instrument your applications to send data securely to your warehouse. Receive events from webhooks of any application
Filesystems
Automatically fetch the latest files written to SFTP and S3 and load them into the warehouse
Support various different extraction modes for the selected data:
Full Customization
Every data integration is different. You need full flexibility on how you choose, extract, and load your data.
Choose
Select the specific data to be extracted based on:
- Schema include/exclude lists
- Table include/exclude lists
- Column include/exclude lists
- Column lists with expressions to perform transformations at the source
- Arbitrary extraction queries to transform data at source before being extracted
Extract
- Extract full snapshots from source
- Extract only updated records in database sources
- Extract all changes via change data capture from database sources
- Capture events using webhooks
- Stream events sent via instrumentation library in several languages
- Choose schedule of fetching each object/table from the source separately
Load
Ensure that data can be loaded into the warehouse with the greatest flexibility
- Replace the destination warehouse table
- Merge updates into destination table so that deletes result in deleted records
- Merge updates into destination table so that deletes result in "soft deletes" - records marked as deleted
- Append data to the destination warehouse table so that there is a full audit of all the changes
Any combination of chosen data, extract modes, and load modes can be used to support specific requirements for analysis.
The Only Cost Effective Option
We use cookies on our website. If you continue to use our website, you are agreeing to our use of cookies in accordance with our Cookie Statement. For information about how to change your cookie settings, please see our Cookie Statement.