Perspica https://perspica.in/ Sharp writing on data engineering, AI, and the systems that make sense of it all. en Tue, 14 Jul 2026 00:00:00 GMT Pub-sub and Queues - Why We Need Both? https://perspica.in/blog/kafka-queue-kip932/ https://perspica.in/blog/kafka-queue-kip932/ Ten years after replacing ActiveMQ with Kafka, I finally understood what we gave up. Here is what changed with native queue semantics in Apache Kafka. Tue, 14 Jul 2026 00:00:00 GMT Data Engineering Kafka What Is a Data Product - and Why "Data as a Product" Is Not the Same Thing https://perspica.in/blog/part3-dataproducts-vs-data-as-products/ https://perspica.in/blog/part3-dataproducts-vs-data-as-products/ Why did the industry need the idea of a 'data product' in the first place? Once you understand that, the distinction between a data product and data as a product becomes obvious. Thu, 02 Jul 2026 00:00:00 GMT Data Architecture Data Mesh Is Data Mesh Right for Your Organisation? An Honest Assessment https://perspica.in/blog/part6-data-mesh-is-it-right/ https://perspica.in/blog/part6-data-mesh-is-it-right/ Most organisations ask this question after buying a platform. Here is a practitioner's guide to asking it before and what to do with the answer. Tue, 30 Jun 2026 00:00:00 GMT Data Architecture Data Mesh The Social Contract of Data Mesh https://perspica.in/blog/part5-data-mesh-social-change/ https://perspica.in/blog/part5-data-mesh-social-change/ The hardest part of data mesh has nothing to do with technology. It is about convincing people to take on accountability they were never designed to carry — and giving them the authority to match it and the incentive to own it. Fri, 26 Jun 2026 00:00:00 GMT Data Architecture Data Mesh Why Data Mesh Keeps Failing — Eight Failure Patterns https://perspica.in/blog/part4-data-mesh-eight-failures/ https://perspica.in/blog/part4-data-mesh-eight-failures/ Data mesh implementations stall not because the idea is wrong. But because organisations keep making the same mistakes — and most of them have nothing to do with technology. Tue, 23 Jun 2026 00:00:00 GMT Data Architecture Data Mesh Everybody Is Buying Data Mesh. But Are They Implementing It? https://perspica.in/blog/part2-what-is-data-mesh/ https://perspica.in/blog/part2-what-is-data-mesh/ Every vendor is selling one. Every enterprise is buying one. Almost none of them are actually building one. Data Mesh is not a technology. It never was. Fri, 19 Jun 2026 00:00:00 GMT Data Architecture Data Mesh The Data Lake That Became a Swamp https://perspica.in/blog/datamesh-1-datalake_swamp/ https://perspica.in/blog/datamesh-1-datalake_swamp/ Enterprises spent billions on data platforms. Most of that data sits unused, untrusted, and completely unfit for AI agents. This is not a technology problem. Mon, 01 Jun 2026 00:00:00 GMT Data Architecture Data Mesh