Monday, December 2, 2019

Using CockroachDB IMPORT with local storage

When doing import/export from CockroachDB there are multiple storage options available.
One option that is less understood is how to do a local import. Based on the conversation
I had with engineering in our brand new community slack, there are several options available.

1. On a single-node cluster, using --external-io-dir option for your import and backup directory.
2. On a multi-node cluster, you may copy your import datasets to every node's extern directory
followed by an IMPORT.
3. The last option is to spin up a local webserver and make your files network-accessible.

Cockroach Labs is working on a more permanent solution when it comes to nodelocal. We
acknowledge the current solution is not perfect and intend to make it less painful.

Demo data generated with Mockaroo.

No comments: