Welcome to curated list of handpicked free online resources related to IT, cloud, Big Data, programming languages, Devops. Fresh news and community maintained list of links updated daily. Like what you see? [ Join our newsletter ]

How container networking works at Platform.sh

Categories

Tags containers kubernetes web-development app-development docker

We’ll take a look at how we wire (most of) it up. In particular, we’ll go over the role of the Platform.sh edge layer, and describe in detail how we network hosts and containers together. From the networking perspective, our job is to make sure that a request directed towards your web server reaches the right container, and that container is able to communicate with other containers that your hosted application depends upon, all while making sure that someone else’s container cannot talk to one of your containers. By Mohammed Ajmal Siddiqui.

The article deals with:

  • What Platform.sh looks like
  • Overlay networks
  • Our ARP rig
  • The Platform.sh ARP Daemon

To sum up, Platform.sh encode the IP of the physical host housing the container within the container IP, and run their own ARP daemon that computes the grid host IP based on the container IP on demand in order to serve the ARP cache of the kernel. Interesting read!

[Read More]

Next.js and GraphQL: The perfect combination for full stack development

Categories

Tags restful nodejs javascript web-development app-development apis

In today’s article we are going to create a full stack application using Next.js with GraphQL Yoga. By Francisco Mendes.

Before starting the article, it is recommended that you have knowledge of React, Next.js and GraphQL. What does this article cover :

  • Next.js App Router and Actions
  • GraphQL Yoga Integration
  • Perform operations such as Get, Create and Delete on the database

The article will walk you in great detail through creating the project, backend setup, connection to database, the creation of GraphQL Schema using Garph to create a totally type-safe API without needing to do codegen, reusable components, routes setup. Code examples are included as well. Nice one!

[Read More]

How to optimize SQL queries for faster data retrieval

Categories

Tags database software performance big-data analytics

SQL (Structured Query Language), as you probably, know, helps you collect data from databases. It is specifically designed for that. In other words, it works with rows and columns, allowing you to manipulate data from databases using SQL queries. By Nate Rosidi.

The article focuses on:

  • Why Do We Need SQL Query Optimization?
  • SQL query optimization techniques
    • Use SELECT With Specified Fields Instead of SELECT ‘*’
    • Avoid Using SELECT DISTINCT
    • Avoid using loops
    • Use wild cards properly
    • Use top or LIMIT to limit the number of sample results
    • Use indexes
    • Bonus section: Use SQL query optimization tools

Due to the complexity of long codes and highly complex queries, you might consider using query optimization tools. You will find a list of tools together with small explanation for each of them at the end of the article. Nice one!

[Read More]

Dynamic table partitioning in Postgres

Categories

Tags database mysql software performance

We helped a customer recently who was storing 500 million chat messages in a single Postgres table. As the table was growing, their queries were slowing down. By Michel Pelletier.

The simple solution we offered was table partitioning. The difficulty was creating the partitions and migrating the data without blocking queries and downtime. This post explores the method we used to solve this - Dynamic Table Partitioning.

Further in this article:

  • Why Partition Data? The large table problem
  • Starting small but getting big
  • Dynamic partitioning with pl/pgSQL
  • Creating parent tables
  • Creating dynamic child tables
  • Progressively copying data from the large tables
  • Setting up a daily cron job to create partitions

While there is some complexity, I hope this example has given you some ideas on how you too can partition your data for optimal query performance. Nice one!

[Read More]

Top open-source IoT platforms in 2023: Complete pros and cons

Categories

Tags iot software-architecture software robotics

Open-source technology has become so important that entire systems like WordPress are built on it. Recently, OpenAI has been making a big impact with its generative AI technology. They trained and created it using data that was freely available to everyone. By Team Bytebeam.

Nowadays, millions of IoT products collect data, analyze it, and make decisions. This data provides valuable information for planning, managing, and making decisions.

The main parts of the article:

  • Understanding open-source IoT platforms
  • Importance of open-source IoT architecture in IoT platforms
  • When should you look for an open-source architecture for your IoT products?
  • Challenges with open source IoT architecture
  • Top open source iot platforms in 2023

In summary, open source offers a great chance for businesses to become more efficient and promote innovation by using shared technology. It’s similar to how standards help in this regard. Therefore, it’s important to select the right IoT platform for your company. Good read!

[Read More]

Nginx security. Control resources and limits.

Categories

Tags servers web-development infosec performance

Nginx is one of the best popular webservers today. Its popularity is due to the fact that it is very fast and easy to set up. Other side of this popularity - nginx is often being a target of malicious attacks. So, if your nginx is not limited by available resources, your server may totally “fall” when nginx spent all system resources. That’s why you should control and limit resources Nginx consumed. By Vyacheslav Breus.

All limits are sets in nginx configuration file. The article gives a good advice on:

  • Global settings
  • Disk operations
  • Compression and caching
  • Security settings

In this article author described how to optimize your nginx works and gave some advices about base security improvements. Nice one!

[Read More]

Raspberry Pi Zero headless quick start

Categories

Tags cio software-architecture devops infosec

This guide shows how to bring up a Raspberry Pi Zero, Zero W, or Zero 2 W without needing to attach a keyboard/mouse/monitor. For older Pi OS releases, basic settings can be configured by editing text files directly on the SD card using an editor on your main PC prior to first boot. For newer Pi OS releases, the rpi-imager tool can be used to both burn the OS image and configure settings. By Carter Nelson.

In this super detailed guide you will find:

  • How to run a sanity check to verify if the Pi Zero is OK
  • Install OS on to SD Card
  • Text file editing
  • Using rpi-imager
  • Suggested initial setup

… and more. Plenty of screenshots and every step is well explained. Nice one!

[Read More]

Comprehensive guide to Internet of Things data streaming from Raspberry Pi to Azure

Categories

Tags cloud azure iot infosec robotics

What comes to mind when you hear “Raspberry Pi in the cloud”? A freshly baked pie floating away, forever out of reach? this blog post aims to paint a simpler picture, showing how easy it is to build your own IoT in the Cloud setup. As mentioned in the preface, this post is part of our ongoing IoT series, where we’ll elevate our Raspberry Pi devices by streaming data into the Microsoft Azure Cloud. By Stepan GaponiukDr and Heiko Kromer.

Further in the guide:

  • Extend the circuit with an LED and a resistor (optional)
  • Create and configure Microsoft Azure IoT Hub
  • Configure Raspberry Pi to send data into Azure IoT Hub
  • Create and configure Microsoft Azure Stream Analytics job
  • Create a Real-time dashboard in Power BI Premium to visualize Reed switch signals sent from Raspberry Pi

Azure IoT Hub is a fully managed service that enables secure and reliable communication between your IoT devices and cloud applications. It acts as a central messaging hub, allowing you to send and receive data, manage devices, and implement security features such as per-device authentication. Link to the repository with the code is also included. Good read!

[Read More]

Best Kubernetes certifications for 2023 [ranked]

Categories

Tags kubernetes containers learning how-to cio devops

Looking for the best Kubernetes certification? In this guide, I explained the best Kubernetes certification along with other free choices, so you can choose the best one for you. Kubernetes is growing in popularity day by day. A survey conducted by Cloud Native Computing Foundation (CNCF) reported that 96% of the respondents are either using or evaluating Kubernetes. By Bibin Wilson.

Engineers getting certified on Kubernetes are also growing at a rapid pace. A report by Kube Careers shows that Kubernetes Certifications stand in second place in the list of popular certifications.

Let’s take a look at each Kubernetes certification and see which one is right for you:

  • Certified Kubernetes Administrator (CKA)
  • Certified Kubernetes Application Developer (CKAD)
  • Certified Kubernetes Security Specialist (CKS)
  • Kubernetes and Cloud Native Associate (KCNA)
  • Certification cost
  • How to register for Kubernetes certification?
  • Which is the popular Kubernetes certification?
  • Kubernetes certified engineers salary stats

As per the latest kube.careers Kubernetes job trends report data, the salary range is between $129,802 & 179,520. And the highest salary reported is between $275,000-319,000. LinkedIn search returned 124,565 results for Kubernetes jobs in the USA. In that for salaries more than $10000, it’s returned 28000 results. And for salaries above $200000, it returned 302 results.

The Linux Foundation CKA is a sought-after Kubernetes certification. CKA is a widely accepted certification that showcases a candidate’s Kubernetes administration and management skills. You will also gain a competitive advantage over peers without the certification as recruiters and organizations are looking for certified professionals. Good read!

[Read More]

Security on the web

Categories

Tags servers web-development infosec app-development browsers

Websites contain several different types of information. Some of it is non-sensitive, for example the copy shown on the public pages. Some of it is sensitive, for example customer usernames, passwords, and banking information, or internal algorithms and private product information. By @mozilla.

Security and privacy are distinct topics, but they are also closely-related. It is worth knowing the difference between the two and how they relate. In this guide you will find info on:

  • Relationship between security and privacy
  • Security services provided by browsers
  • Security considerations for client-side developers
  • Store client-side data responsibly
  • Protect user identity and manage logins
  • Don’t include sensitive data in URL query strings
  • Enforce usage policies
  • Maintain data integrity
  • Sanitize form input
  • Protect against clickjacking

… and more. Handling data responsibly is largely concerned with cutting down on cookie usage and being careful about the data you store in them. You should prepare for the removal of cross-site cookies by limiting the amount of tracking activities you rely on and/or by implementing desired information persistence in other ways. Excellent read!

[Read More]