Image Ingest

ndstore is a spatial database designed for quickly writing, retrieving, accessing, analyzing, and visualizing large data volumes. Datasets in ndstore range in size from a few hundred MB (in the case of MRI), up to hundreds of TB (in the case of EM). If you are collecting or have a spatial dataset that you wish to share, storing it in ndstore is a tremendous first step.

The process of putting your data in ndstore is referred to as "ingesting" your data. This process requires several steps, including understanding metadata about your images, creating a dataset/project/token for storing and accessing your data in the system, and uploading your data in one of several ways, determined by what makes the most sense given the current location and size of your data.

Step 1: Get metadata

Prior to creating entries in the database for your data, it is important to know and understand different properties of your data. Many of these properties can be found by interrogating your images, while others may require more intimate knowledge of the image acquisition. Please follow our get metadata tutorial to fulfill this step.

Step 2: Create dataset

Once metadata is collected, you can create the dataset, project, token, and channels for your image collection. These can be thought of as detailed pointers describing what your data are, and where they can be accessed in the database. Please follow our create dataset tutorial to setup the database for your image collection.

Step 3: Ingest your data

You can now ingest via one of our several ingestion methods. Here, are your options and their respective tutorials:

  • autoingest (Note: does not require previous two steps, but requires web accessible data)