BigQuery Expression
A BigQuery expression is used in BigQuery Persistence Mappings to define the location of data in a BigQuery project.
Data Source
Distributed File System Source (e.g., S3, Google Cloud Storage, Azure Storage)
Database Expression
A database expression is used in Persistence Mappings to define the location of data in a database.
File
A file is used in File System Persistence Mappings to define the location and format of data on a filesystem. There are many types of files, and each type may…
Kafka Offsets
Kafka offsets are used in Kafka Mappings to specify when to start and stop querying data from a Kafka cluster for a Magpie table or stream.
Kafka Subscription
A Kafka subscription is used in Kafka Mappings to define the data that is included in a Kafka-backed Magpie table or stream. There are many types of Kafka…
Staging File
A staging file is used when reading from or writing to some cloud data warehouses, such as Amazon Redshift and Google BigQuery.
HDFS Credentials
AWS Access Key Credentials
Repository
Specification
Schema
Specification
Field
Specification
Table
Specification
Persistence Mapping
A persistence mapping defines the underlying data for a Magpie table. Usually, this is a location on a Magpie data source (e.g., a file or files in a…