Tag: Database
-
A serverless query engine from spare parts
Posted on May 7, 2023, Level intermediate Resource Length medium
An open-source implementation of a Data Lake with DuckDB and AWS Lambdas. In this post we will show how to build a simple end-to-end application in the cloud on a serverless infrastructure. The purpose is simple: we want to show that we can develop directly against the cloud while minimizing the cognitive overhead of designing and building infrastructure. By Ciro Greco.
Tags data-science streaming apis database serverless open-source
-
Introducing storage on Vercel
Posted on May 6, 2023, Level beginner Resource Length short
Vercel KV, Vercel Postgres, Vercel Blob, and Vercel Edge Config are now available. Driven by the need for both performance and personalization, frameworks are becoming server-first and edge-first. By vercel.com.
Tags app-development web-development apis database serverless nosql
-
Distributed cloud-native graph database with NebulaGraph Docker extension
Posted on May 4, 2023, Level intermediate Resource Length medium
Graph databases have become a popular solution for storing and querying complex relationships between data. As the amount of graph data grows and the need for high concurrency increases, a distributed graph database is essential to handle the scale. Finding a distributed graph database that automatically shards the data, while allowing businesses to scale from small to trillion-edge-level without changing the underlying storage, architecture of the service, or application code, however, can be a challenge. By Wey Gu and Ajeet Singh Raina.
Tags app-development docker cio containers devops database
-
Comparisons of proxies for MySQL
Posted on April 11, 2023, Level intermediate Resource Length long
HAProxy, ProxySQL, MySQL Router (AKA MySQL Proxy); in the last few years, I had to answer multiple times on what proxy to use and in what scenario. When designing an architecture, many components need to be considered before deciding on the best solution. By Marco Tusa.
Tags mysql database performance how-to devops
-
How to connect to MySQL remotely with SSH PuTTY Tunnels: A step-by-step guide
Posted on April 6, 2023, Level beginner Resource Length long
MySQL is a popular relational database management system to organize and store data. Depending on your specific use cases and preferences, you can connect to a MySQL Server through a command-line interface, using GUI tools,such as dbForge Studio for MySQL, programming languages or via web-based interfaces such as phpMyAdmin. By Julia Evans.
Tags infosec cloud devops database servers
-
How to orchestrate an ETL Data Pipeline with Apache Airflow
Posted on March 10, 2023, Level intermediate Resource Length medium
Data Orchestration involves using different tools and technologies together to extract, transform, and load (ETL) data from multiple sources into a central repository. By Aviator Ifeanyichukwu.
Tags apache database nosql data-science python big-data
-
Write reusable code for AppSync JavaScript resolvers
Posted on March 6, 2023, Level beginner Resource Length short
Learn how to share code between AppSync JS resolvers. AWS AppSync is a fully managed service that allows developers to build scalable and performant GraphQL APIs. It is also serverless, meaning that you will only pay for what you use. By Benoît Bouré.
Tags nodejs javascript aws frontend apis database
-
Build your own command-line replica with GTID aware mariadb binlog
Posted on February 24, 2023, Level advanced Resource Length medium
This blog post begins a three part series to create and customize your own asynchronous MariaDB replication client. With the release of MariaDB Community Server 10.8.1, the mariadb-binlog command line utility now supports both 1) filtering events by GTID ranges, and 2) validating a binary log's ordering of Global Transaction IDentifiers (GTIDs). By Brandon Nesterenko.
Tags app-development mysql database performance
-
Storing OpenAI embeddings in Postgres with pgvector
Posted on February 8, 2023, Level beginner Resource Length medium
A new PostgreSQL extension is now available in Supabase: pgvector, an open-source vector similarity search. By Greg Richardson.
Tags cloud machine-learning devops bots database
-
2023 state of databases for serverless & edge
Posted on February 2, 2023, Level intermediate Resource Length medium
There's been massive innovation in the database and backend space for developers building applications with serverless and edge compute. There are new tools, companies, and even programming models that simplify how developers store data. By Lee Robinson.
Tags serverless cio cloud database iot devops
-
Using Apache Kafka to process 1 trillion inter-service messages
Posted on January 27, 2023, Level intermediate Resource Length long
Cloudflare has been using Kafka in production since 2014. We have come a long way since then, and currently run 14 distinct Kafka clusters, across multiple data centers, with roughly 330 nodes. Between them, over a trillion messages have been processed over the last eight years. By Matt Boyle.
Tags event-driven apache apis app-development database
-
Entity to DTO – how-to
Posted on December 20, 2022, Level intermediate Resource Length medium
DTO is probably the most straightforward pattern in object-oriented programming. What could be the motives for using DTOs in our applications? By Andrey Belyaev.
Tags database oop web-development app-development java