Tag: Queues
-
Understanding messaging queues: The backbone of modern software architecture
Posted on September 24, 2024, Level beginner Resource Length medium
In today's fast-paced and interconnected digital world, the need for robust and efficient communication between different components of a software system is paramount. Messaging queues have emerged as a vital solution to this challenge, providing a reliable way to manage and coordinate the flow of messages between various parts of an application. By Sean Coughlin.
Tags queues learning app-development devops messaging
-
The benefits of event-driven architecture
Posted on March 7, 2024, Level intermediate Resource Length medium
Event-driven architecture (EDA) is a software design pattern used in microservices or other decoupled services or apps. Each service in the ecosystem can asynchronously publish and subscribe to events via an event broker. By Darryn Campbell.
Tags web-development app-development queues streaming event-driven
-
Choosing between message queues and event streams
Posted on January 19, 2024, Level beginner Resource Length medium
Implementing an event-driven architecture (EDA) is a road riddled with challenges. Among them is choosing the right tooling for the job. Many event-driven tools seem quite similar, at least at first glance, and you'd expect they could be used equally well for the same purposes. But that's often not the case and choosing the solution best suited to your needs can be tricky. By Tun Shwe.
Tags cicd messaging event-driven queues
-
Streams in Scala - introductory guide
Posted on September 19, 2023, Level intermediate Resource Length medium
Streams in Scala provide a lazy evaluation mechanism where elements are computed on-demand rather than being eagerly evaluated and stored in memory. This allows for efficient memory utilization, especially when dealing with large datasets or potentially infinite sequences of data. By Aniefiok Akpan.
Tags akka scala programming learning streaming queues
-
Delivering messages at the scale of the World Cup
Posted on June 29, 2023, Level intermediate Resource Length medium
Events like the World Cup bring together a huge number of fans like Alex all over the world. The biggest challenge in maintaining such a service is scale. The type of traffic for such events can be extremely spiky. A very steady traffic volume can suddenly spike when Mbappe scores the goal that ties the game. Suddenly, FCM needs to notify 250M users about this event. By Michelangelo Mecozzi.
Tags messaging cloud queues nosql microservices
-
Comparing Avro vs Protobuf for data serialization
Posted on April 18, 2023, Level beginner Resource Length short
Data serialization is a crucial aspect of modern distributed systems because it enables the efficient communication and storage of structured data. In this article, we will discuss two popular serialization formats: Avro and Protocol Buffers, Protobuf for short, and compare their strengths and weaknesses to help you make an informed decision about which one to use in your projects. By Daniel Selans.
Tags json queues messaging app-development streaming apache
-
Data structures 101: How to use stacks and queues in Java
Posted on January 17, 2023, Level intermediate Resource Length long
Mastering data structures is a non-negotiable skill for success as a developer. Efficient data structures help execute effective programs. Today, many programming roles require great knowledge of data structures. They are also a fundamental part of coding interviews. By The Educative Team.
Tags java app-development programming queues data-science
-
How Pub/Sub eliminates boring meetings and makes your systems scale
Posted on November 21, 2022, Level intermediate Resource Length medium
So, you've said goodbye to the monolithic application and refactored it into services. You are shipping faster and the code is cleaner. But the complexity of communication between the services is causing performance issues. And every time a new team needs to integrate, it's a whole lot of meetings. By Priyanka Vergadia, Kir Titievsky.
Tags devops software-architecture code-refactoring messaging queues
-
Multi-dimensional approach helps you proactively prepare for failures: Application layer
Posted on August 17, 2022, Level intermediate Resource Length medium
Resiliency of applications surpasses everything else in building customer trust. Because of this, it cannot be an afterthought. Instead of simply reacting to a failure, why not be proactive?. By Piyali Kamra, Aish Gopalan, Isael Pimentel, and Aditi Sharma.
Tags software-architecture devops microservices performance app-development queues
-
Securing Kafka infrastructure at Uber
Posted on June 27, 2022, Level intermediate Resource Length medium
Uber has one of the largest deployments of Apache Kafka® in the world. It empowers a large number of real-time workflows at Uber, including pub-sub message buses for passing event data from the rider and driver apps, as well as financial transaction events between the backend services. By Prateek Agarwal, Ryan Turner, and KK Sriramadhesikan.
Tags software-architecture infosec devops performance queues messaging streaming distributed
-
Building Real-Time ETL Pipelines with Apache Kafka
Posted on February 17, 2022, Level beginner Resource Length short
Whether you're a data engineer, a data scientist, a software developer, or someone else working in the field of software and data - it's very likely that you have implemented an ETL pipeline before. By Stefan Sprenger.
Tags apache database queues messaging big-data
-
OPC UA, MQTT, and Apache Kafka - The Trinity of data streaming in IoT
Posted on February 13, 2022, Level beginner Resource Length long
In the IoT world, MQTT and OPC UA have established themselves as open and platform-independent standards for data exchange in Industrial IoT and Industry 4.0 use cases. Data Streaming with Apache Kafka is the data hub for integrating and processing massive volumes of data at any scale in real-time. By Kai Waehner.
Tags queues messaging cloud analytics