spice-data-connector
Connect Spice to data sources like PostgreSQL, MySQL, S3, Databricks, Snowflake, and more. Use when asked to "add a dataset", "connect to a database", "load data from S3", or "configure a data source".
Connect Spice to data sources like PostgreSQL, MySQL, S3, Databricks, Snowflake, and more. Use when asked to "add a dataset", "connect to a database", "load data from S3", or "configure a data source".
Spice Data Connectors
Data Connectors enable federated SQL queries across databases, data warehouses, data lakes, and files.
Basic Dataset Configuration
datasets:
- from: <connector>:<identifier>
name: <dataset_name>
params:
# connector-specific parameters
acceleration:
enabled: true # optional: enable local caching
engine: duckdb # arrow, duckdb, sqlite, postgres
Supported Connectors
| Connector | From Format | Status |
|---|---|---|
| PostgreSQL | postgres:schema.table |
Stable |
| MySQL | mysql:schema.table |
Stable |
| S3 | s3://bucket/path/ |
Stable |
| DuckDB | duckdb:database.table |
Stable |
| Databricks | databricks:catalog.schema.table |
Stable |
| Snowflake | snowflake:database.schema.table |
Beta |
| File | file:./path/to/file.parquet |
Stable |
| Delta Lake | delta_lake:/path/to/delta/ |
Stable |
| MongoDB | mongodb:collection |
Alpha |
| Clickhouse | clickhouse:database.table |
Alpha |
Documentation
You Might Also Like
Related Skills
zig-system-calls
Guides using bun.sys for system calls and file I/O in Zig. Use when implementing file operations instead of std.fs or std.posix.
oven-sh
bun-file-io
Use this when you are working on file operations like reading, writing, scanning, or deleting files. It summarizes the preferred file APIs and patterns used in this repo. It also notes when to use filesystem helpers for directories.
anomalyco
vector-index-tuning
Optimize vector index performance for latency, recall, and memory. Use when tuning HNSW parameters, selecting quantization strategies, or scaling vector search infrastructure.
wshobsonsimilarity-search-patterns
Implement efficient similarity search with vector databases. Use when building semantic search, implementing nearest neighbor queries, or optimizing retrieval performance.
wshobsondbt-transformation-patterns
Master dbt (data build tool) for analytics engineering with model organization, testing, documentation, and incremental strategies. Use when building data transformations, creating data models, or implementing analytics engineering best practices.
wshobsonevent-store-design
Design and implement event stores for event-sourced systems. Use when building event sourcing infrastructure, choosing event store technologies, or implementing event persistence patterns.
wshobson