Skip to content

Commit 390f23c

Browse files
committed
Ingest: Add page about ingestion methods
1 parent 2c95170 commit 390f23c

File tree

3 files changed

+70
-1
lines changed

3 files changed

+70
-1
lines changed

docs/index.md

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -307,6 +307,7 @@ use-cases.
307307
install/index
308308
connect/index
309309
getting-started
310+
Ingestion <ingest/index>
310311
feature/index
311312
admin/index
312313
performance/index

docs/ingest/index.md

Lines changed: 68 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,68 @@
1+
(ingest)=
2+
# CrateDB data ingestion
3+
4+
:::{include} /_include/styles.html
5+
:::
6+
7+
All data ingestion methods for CrateDB at a glance.
8+
9+
:::::{grid} 1 2 2 2
10+
:margin: 4 4 0 0
11+
:padding: 0
12+
:gutter: 2
13+
14+
::::{grid-item-card} {material-outlined}`file_upload;2em` Load data using CrateDB
15+
- {ref}`Import files <crate-reference:sql-copy-from>`
16+
17+
Load data from the local filesystem or from remote sources using CrateDB's
18+
native `COPY FROM` SQL statement.
19+
20+
**Protocols:** HTTP, FTP, Blob Storage (AWS S3, Azure)
21+
<br>
22+
**Formats:** CSV, JSON Lines
23+
24+
- {ref}`fdw`
25+
26+
Make data in remote database servers available as tables within CrateDB.
27+
You can then query these foreign tables like regular user tables.
28+
+++
29+
Data import methods supported by CrateDB natively.
30+
::::
31+
32+
::::{grid-item-card} {material-outlined}`cloud_upload;2em` Load data using CrateDB Cloud
33+
- {ref}`Import files <cloud:cluster-import>`
34+
35+
Managed data loading from remote sources using CrateDB Cloud's ETL subsystem.
36+
37+
**Protocols:** HTTP, Blob Storage (AWS S3, Azure)
38+
<br>
39+
**Formats:** CSV, JSON Lines, Parquet
40+
41+
- {ref}`MongoDB CDC integration <cloud:integrations-mongo-cdc>`
42+
43+
CrateDB Cloud enables continuous data ingestion from MongoDB using Change Data Capture
44+
(CDC), providing seamless, real-time synchronization of your data.
45+
+++
46+
Data import methods provided by CrateDB Cloud.
47+
::::
48+
49+
::::{grid-item-card} {material-outlined}`arrow_circle_up;2em` Load data using external systems
50+
- {ref}`Extract Transform Load (ETL) <etl>`
51+
52+
Ingest data with polyglot data integration platforms or libraries
53+
and complete ETL solutions.
54+
55+
- {ref}`cdc`
56+
57+
Integrate with third-party change-data-capture (CDC) tools.
58+
59+
- {ref}`telemetry`
60+
61+
Ingest telemetry data—metrics, logs, and traces—from monitoring
62+
and sensor collector systems.
63+
64+
+++
65+
Supported industry-standard frameworks and paradigms.
66+
::::
67+
68+
:::::

docs/integrate/telemetry/index.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,7 +1,7 @@
11
(metrics)=
22
(telemetry)=
33
(integrate-metrics)=
4-
# Store telemetry data in CrateDB
4+
# Telemetry data
55

66
CrateDB integrations with metrics collection agents, brokers, and stores.
77
This documentation section lists applications and daemons which can

0 commit comments

Comments
 (0)