Data

Data components are engineered to effortlessly integrate with a wide range of data providers. They provide users with the essential tools to forge connections with numerous data providers and vendors, making the data extraction and loading process more straightforward. Pipeline utilizes these Data components to extract data, transform it using AI components, and subsequently deliver the processed data to the intended destinations.

NameDescription
BigQueryInsert data to BigQuery tables.
ChromaBuild and search vector datasets.
ElasticsearchAccess the Elasticsearch database.
Google Cloud StorageUpload data to Google's Cloud Storage.
Google DriveConnect to, and read files and folders within an existing Google Drive.
Google SheetsConnect to and interact with Google Sheets spreadsheets to read and write data.
Instill ArtifactAccess files and perform RAG-based search and retrieval through catalogs in the Instill Core platform.
MilvusBuild and search vector datasets.
MongoDBAccess the MongoDB NoSQL database.
PineconeBuild and search vector datasets.
QdrantBuild and search vector datasets.
RedisManage data in NoSQL Redis databases.
SQLAccess the SQL database of your choice.
WeaviateBuild and search vector datasets.
ZillizBuild and search vector datasets.