I think you’re understating how many quic implementations exist. Google, Apple, F5, Facebook, Fastly, Cloudflare, Microsoft, AWS all have separate implementations servicing significant production traffic, most of them open source. That doesn’t even count the smaller, language-specific implementations. Searching for quic interop tests is a good way to discover the various implementations.
Failures while communicating to the external systems (the kv store and elastic in your example) are usually where this falls down. It's easy to build a system that's consistent ~90% of the time, but if you want to build a system where things like failures during snapshot write or failures during export to elastic are handled properly it starts getting complex (you will need to find ways to recover and retract data, or build smarts into the consumer to query around aborts, or find a way to do a 2PC-esque dance with the external system a la Kafka's transaction support, etc.). Getting to full consistency isn't easy.
This has been my experience too. Instead of going the logical replication route I tend to leverage the transactional outbox to achieve consistency in the application layer instead.
So when I transact data into tables I immediately fetch the latest outbox id.
And then when query from Elasticsearch I first fetch what the last outbox id of the processed data is.
This way I know if the transaction was already processed into Elasticsearch or not. Repeat. Until outbox id of Elasticsearch is equal or higher than the outbox id of the mutation.
This way I don't have to use logical replication, no k/v store and I can just use a script that fetches and processes the latest outbox changes on a loop.
It's very hard for Kafka Connect plugins to maintain consistency in all scenarios - both because of the semantics of some upstream databases, and because of the guarantees the connect API itself offers. Hopefully KIP-618 will eliminate more of the edge cases though.
IRC is excellent, and located around the Bay Area (there are usually at least a few people carpooling down from Oakland) - https://www.insightretreatcenter.org
It's the retreat side of IMC (https://www.insightmeditationcenter.org). You might listen to some of their talks or read some of Gil's writing[1] to see if it's what you are looking for. It's in the Vipassana tradition, though a number of the teachers had affiliation with the SF Zen Center.
Allen Webster, the creator, was recently interviewed on the Handmade podcast. I thought it was a good discussion - touched on text editors, performance, and some interesting programming language ideas. https://handmade.network/podcast/ep/14a5407e-5f73-4c59-a422-...
Many of the current users, including the creator, are in gamedev. Being extensible in a language they’re already intimately familiar with is a selling point.
