Tag: Apache
-
Building an adaptive, multi-tenant stream bus with Kafka and Golang
Posted on February 20, 2020, Level intermediate Resource Length medium
Back in the 2000s, SOAP/WSDL with ESB (Enterprise Service Bus) was the dominant server-side architecture for many companies. Since the 2010s, microservices and service mesh technologies have grown wildly and thus became the de-facto industry standards. By Xinyu Liu.
Tags software-architecture apache streaming apis devops web-development programming
-
Exploring an Apache Kafka to Pub/Sub migration: Major considerations
Posted on January 28, 2020, Level intermediate Resource Length medium
In many cases, Google's Pub/Sub messaging and event distribution service can successfully replace Apache Kafka, with lower maintenance and operational costs, and better integration with other Google Cloud services. By Leonid Yankulin.
Tags software-architecture apache streaming big-data machine-learning google
-
Using Tableau with Kafka: How to build a real-time SQL dashboard on streaming data
Posted on November 9, 2019, Level intermediate Resource Length medium
Scott Morris, Software Engineer at Rockset wrote this piece about building a real-time dashboard for operational monitoring and analytics on streaming event data from Kafka, which often requires complex SQL, including filtering, aggregations, and joins with other data sets.
Tags big-data data-science software-architecture apache
-
Why I recommend my clients NOT use KSQL and Kafka Streams
Posted on October 24, 2019, Level beginner Resource Length medium
An article by Jesse Anderson. He recommends his clients not use Kafka Streams because it lacks checkpointing. Kafka Streams also lacks and only approximates a shuffle sort. KSQL sits on top of Kafka Streams and so it inherits all of these problems and then some more.
Tags streaming software-architecture apache distributed
-
Full text search with Node.js and ElasticSearch on Docker
Posted on September 18, 2019, Level intermediate Resource Length long
An article by Michele Riva about building the search engine for simple REST API using Node.js and ElasticSearch. ElasticSearch is a search engine server built on top of Lucene with an amazing distributed-architecture support.
Tags search servers apache web-development
-
Using graph processing for Kafka Stream visualizations
Posted on September 9, 2019, Level intermediate Resource Length long
Article by David Allen. Focused on Graph processing for Kafka Stream visualizations. Apache Kafka® is great when one needs to dealing with streams, allowing you to conveniently look at streams as tables. Stream processing engines like KSQL furthermore give you the ability to manipulate all of this fluently.
Tags analytics apache streaming queues
-
Distributed tracing with Apache Kafka and Jaeger
Posted on June 29, 2019, Level advanced Resource Length long
An article by Aaron Burk about distributed systems. Kafka decouples consumers and producers (meaning applications do not directly communicate with each other) it can be a challenge to illustrate exactly how data flows through your system. Author demonstrates how Jaeger is up to the challenge while navigating the pitfalls of an example project.
Tags programming monitoring servers devops apache
-
How we use Apache Kafka and the Confluent Platform
Posted on June 4, 2019, Level intermediate Resource Length short
Jendrik Poloczek from confluent.io published this article about their experience building the core infrastructure to integrate, clean, and analyze blockchain data.
Tags blockchain apache apis data-science scala
-
Introduction to message brokers -- Apache Kafka vs. RabbitMQ
Posted on May 8, 2019, Level intermediate Resource Length long
If you're looking for a message broker for your next project, read on to get an overview of to of the most popular open source solutions out there. Introduction by Vitaliy Samofal.
Tags devops distributed event-driven apache
-
Kafka-Streams -- road to autoscaling via Kubernetes
Posted on April 16, 2019, Level intermediate Resource Length long
This article is based on the talk Scale in / Scale out with Kafka-Streams and Kubernetes from Xebicon'18. Loïc Divad is the author of this article and he aims to present a few advantages that come with specific practices related to Kafka-Streams like containerization and orchestration, and especially autoscaling.
Tags kubernetes apis apache devops
-
Solr from the field -- Lessons learned while maintaining over 30 billion documents
Posted on August 14, 2018, Level intermediate Resource Length medium
An article published by Alex Puschinsky about WalkMe Insights experience with SOLR and processing of vast amount of data. They provide real-time search and analytics capabilities. To achieve this, they have chosen Apache Solr as the core of our WalkMe Insights search functionality.
Tags apache search web-development
-
Apache Kafka is not for event sourcing
Posted on February 1, 2018, Level beginner Resource Length medium
Jesper Hammarbäck article in which he argues why Kafka is not the best tool for event sourcing. Kafka is a great tool for delivering messages between producers and consumers and the optional topic durability allows you to store your messages permanently. Forever if you'd like.
Tags software-architecture apache streaming big-data machine-learning