Posts

Emitting Protocol Buffers with CockroachDB CDC Queries

Image
As of this writing, CockroachDB does not have official support for protobuf payload as part of change data capture. Today, I am going to demonstrate a feature that may or may not land in CockroachDB proper. The product team is looking into viability of the feature before we can officially support it. Previous articles on CockroachDB CDC Using CockroachDB CDC with Apache Pulsar Using CockroachDB CDC with Azure Event Hubs Using CockroachDB CDC with Confluent Cloud Kafka and Schema Registry SaaS Galore: Integrating CockroachDB with Confluent Kafka, FiveTran and Snowflake CockroachDB CDC using Minio as cloud storage sink CockroachDB CDC using Hadoop Ozone S3 Gateway as cloud storage sink Motivation Protocol Buffers are language-neutral, platform-neutral extensible mechanisms for serializing structured data. It's a common choice for platforms needing to pass messages between systems. CockroachDB is a distributed SQL database built on a transactional and strongly-consi...

CockroachDB TIL: Volume 13

Image
This is my series of articles covering short "Today I learned" topics as I work with CockroachDB. Today, we're diagnosing cert issues, looking at client verification of server certificates differences in the cockroach and the psql clients, and checking the node and the CA certificate expiration programmatically. Previous articles Volume 1 Volume 2 Volume 3 Volume 4 Volume 5 Volume 6 Volume 7 Volume 8 Volume 9 Volume 10 Volume 11 Volume 12 Topics Topic 1: Diagnose certificate based authentication Topic 2: Differences between cockroach and psql clients for client verification of server certificates Topic 3: Capture the node and the CA certificate expiration programmatically Topic 4: Check the client certificate expiration Topic 1: Diagnose certificate based authentication I was using CockroachDB Serverless with a product called PolyScale.ai for an article I was writing and I've run into a strange issue with certificate-based authN. ...

Using DuckDB with CockroachDB

Image

Reducing network latency and improving read performance with CockroachDB and PolyScale.ai

Image

Load balancer high availability with CockroachDB and HAProxy

Image

Connection pool high availability with CockroachDB and PgCat

Image

CockroachDB TIL: Volume 12

Image
This is my series of articles covering short "Today I learned" topics as I work with CockroachDB. Today, we're finding partial indexes, identifying the DB Console URL with SQL, experimenting with a light weight pooler called pgcat , handling client disconnects and improving UX with PGSERVICEFILE Previous articles Volume 1 Volume 2 Volume 3 Volume 4 Volume 5 Volume 6 Volume 7 Volume 8 Volume 9 Volume 10 Volume 11 Topics Topic 1: Identify partial indexes Topic 2: Capture the DB Console URL with SQL Topic 3: Experimenting with pgcat Topic 4: CockroachDB and pgbench client disconnects Topic 5: CockroachDB and PGSERVICEFILE Topic 1: Identify partial indexes Our engineering team has issued a technical advisory #96924 where certain schema changes like dropping columns referenced in partial indexes will fail. A customer asks how to identify databases, tables and the associated partial indexes referencing columns to be dropped. The following meth...