Using CockroachDB IMPORT with local storage
When doing import/export from CockroachDB there are multiple storage options available.
One option that is less understood is how to do a local import. Based on the conversation
I had with engineering in our brand new community slack, there are several options available.
1. On a single-node cluster, using --external-io-dir option for your import and backup directory.
2. On a multi-node cluster, you may copy your import datasets to every node's extern directory
followed by an IMPORT.
3. The last option is to spin up a local webserver and make your files network-accessible.
Cockroach Labs is working on a more permanent solution when it comes to nodelocal. We
acknowledge the current solution is not perfect and intend to make it less painful.
Demo data generated with Mockaroo.
One option that is less understood is how to do a local import. Based on the conversation
I had with engineering in our brand new community slack, there are several options available.
1. On a single-node cluster, using --external-io-dir option for your import and backup directory.
2. On a multi-node cluster, you may copy your import datasets to every node's extern directory
followed by an IMPORT.
3. The last option is to spin up a local webserver and make your files network-accessible.
Cockroach Labs is working on a more permanent solution when it comes to nodelocal. We
acknowledge the current solution is not perfect and intend to make it less painful.
Demo data generated with Mockaroo.
Comments