Tag: Messaging
-
Postgres: Better message queue than Kafka?
Posted on October 13, 2022, Level intermediate Resource Length long
Today author is going to talk about why they made the unconventional decision to build thier logging system on top of Postgres, what worked well, what didn't work well, and how they did it. By Pete Hunt.
Tags apache mysql app-development database messaging
-
Uber freight carrier metrics with near-real-time analytics
Posted on September 7, 2022, Level beginner Resource Length long
Uber Freight has been around since 2016 and is dedicated to provide a platform to seamlessly connect shippers with carriers. We're simplifying the lives of trucking companies by providing a platform for carriers to browse through all available shipment opportunities with upfront pricing and book with the tap of a button, and making the fulfillment process more scalable and efficient. By Ujwala Tulshigiri, Yeqing Lu, Ting Chen, Branden Colen.
Tags data-science apache event-driven messaging distributed devops
-
How to visualize your Apache Kafka data the easy way with stream lineage
Posted on July 24, 2022, Level intermediate Resource Length long
Understanding how data flows and is transformed across the different layers of an organization's application and data stack is one of the most challenging governance problems companies are facing today. Who is producing data? By David Araujo and Julia Peng.
Tags app-development messaging apis apache streaming
-
Securing Kafka infrastructure at Uber
Posted on June 27, 2022, Level intermediate Resource Length medium
Uber has one of the largest deployments of Apache Kafka® in the world. It empowers a large number of real-time workflows at Uber, including pub-sub message buses for passing event data from the rider and driver apps, as well as financial transaction events between the backend services. By Prateek Agarwal, Ryan Turner, and KK Sriramadhesikan.
Tags software-architecture infosec devops performance queues messaging streaming distributed
-
Rapid event notification system at Netflix
Posted on May 3, 2022, Level intermediate Resource Length medium
Netflix has more than 220 million active members who perform a variety of actions throughout each session, ranging from renaming a profile to watching a title. Reacting to these actions in near real-time to keep the experience consistent across devices is critical for ensuring an optimal member experience. By Ankush Gulati, David Gevorkyan.
Tags streaming messaging kubernetes containers devops infosec
-
How to develop Event-Driven architectures
Posted on March 30, 2022, Level beginner Resource Length medium
Author is going to look at how we can use Open source Chronicle Queue and Chronicle Wire to structure applications to use Event-Driven Architecture (EDA). EDA is a design pattern in which decoupled components (often microservices) can asynchronously publish and subscribe to events. By Rob Austin.
Tags event-driven web-development app-development messaging java software-architecture
-
An introduction to event-driven architecture
Posted on March 28, 2022, Level beginner Resource Length short
What is an Event-driven Architecture?. This concept of event-driven architecture (EDA) refers to the new message processing method, which interacts through generation and consumption events, and is generally implemented through a publish-subscribe model? By JIN.
Tags miscellaneous cio event-driven messaging app-development programming
-
Apache Kafka and MQTT - Overview and Comparison
Posted on March 23, 2022, Level beginner Resource Length medium
Apache Kafka and MQTT are a perfect combination for many IoT use cases. This blog series covers various use cases across industries including connected vehicles, manufacturing, mobility services, and smart city. This is part 1: Overview + Comparison. By Kai Waehner.
Tags devops cloud learning messaging
-
Building Real-Time ETL Pipelines with Apache Kafka
Posted on February 17, 2022, Level beginner Resource Length short
Whether you're a data engineer, a data scientist, a software developer, or someone else working in the field of software and data - it's very likely that you have implemented an ETL pipeline before. By Stefan Sprenger.
Tags apache database queues messaging big-data
-
OPC UA, MQTT, and Apache Kafka - The Trinity of data streaming in IoT
Posted on February 13, 2022, Level beginner Resource Length long
In the IoT world, MQTT and OPC UA have established themselves as open and platform-independent standards for data exchange in Industrial IoT and Industry 4.0 use cases. Data Streaming with Apache Kafka is the data hub for integrating and processing massive volumes of data at any scale in real-time. By Kai Waehner.
Tags queues messaging cloud analytics
-
Streaming analytics with Apache Pulsar and Spark structured streaming
Posted on February 12, 2022, Level beginner Resource Length long
Apache Pulsar, a promising new toolkit for distributed messaging and streaming. In this piece we combine two of our favorite pieces of tech: Apache Pulsar and Apache Spark. By Daniel Ciocîrlan.
Tags queues messaging big-data apache cio cloud analytics
-
Processing time-series data with Redis and Apache Kafka
Posted on June 22, 2021, Level beginner Resource Length medium
Learn how to analyze time-series data through RedisTimeSeries with Apache Kafka in this practical walkthrough. RedisTimeSeries is a Redis module that brings native time-series data structure to Redis. By Abhishek Gupta.
Tags app-development apache microservices nosql event-driven messaging