Welcome to curated list of handpicked free online resources related to IT, cloud, Big Data, programming languages, Devops. Fresh news and community maintained list of links updated daily. Like what you see? [ Join our newsletter ]

Introduction to Web Audio API

Categories

Tags apis devops web-development app-development miscellaneous browsers

A critical part of WebRTC is the transmission of audio. Web Audio API is all about processing and synthesizing audio in web applications. It allows developers to create complex audio processing and synthesis using a set of high-level JavaScript objects and functions. By Madhu Balakrishna.

Web Audio API provides several ways to capture and playback audio in web applications. The article then details:

  • Capture and playback audio
  • Autoplay
  • Codecs
  • Permissions
  • Audio processing

Web Audio API provides a powerful set of tools for manipulating audio, including filtering, mixing, and processing. This allows developers to create web-based audio editing tools that can be used to record, edit, and export audio. Authors covered the basics of Web Audio transmission and concepts around it in case of WebRTC in this blog post. There is more to catch up on this topic. Nice read!

[Read More]

Deploy Apache Flink cluster on Kubernetes

Categories

Tags apache devops cloud data-science big-data

When it comes to deploying Apache Flink on Kubernetes, you can do it in two modes, either session cluster or job cluster. A session cluster is a running standalone cluster that can run multiple jobs, while a Job cluster deploys a dedicated cluster for each job. By Elvis David.

Apache Flink is a framework and distributed processing engine for stateful computations over unbounded and bounded data streams. Flink has been designed to run in all common cluster environments, perform computations at in-memory speed and at any scale.

In the article you will find clear advice on session cluster:

  • Deployment object which specifies the JobManager
  • Deployment object which specifies the TaskManagers
  • A service object exposing the JobManager’s REST APIs

The TaskManager can be configured with a certain number of processing slots which gives the ability to execute several tasks at the same time and this is what we call Parallelism.

Following this guide you will create a deployment object which will be used to instantiate our JobManager. This deployment object will create a single JobManager with the container image Flink-1.10.0 for scala and exposes the container ports for RPC communication, blob server, queryable state server and web UI. Files needed for deployment are included. Nice one!

[Read More]

How to orchestrate an ETL Data Pipeline with Apache Airflow

Categories

Tags apache database nosql data-science python big-data

Data Orchestration involves using different tools and technologies together to extract, transform, and load (ETL) data from multiple sources into a central repository. By Aviator Ifeanyichukwu.

Apache Airflow is an open-source platform for developing, scheduling, and monitoring batch-oriented workflows. Airflow’s extensible Python framework enables you to build workflows connecting with virtually any technology. A web interface helps manage the state of your workflows. Airflow is deployable in many ways, varying from a single process on your laptop to a distributed setup to support even the biggest workflows.

Data orchestration typically involves a combination of technologies such as data integration tools and data warehouses. What you will learn in this article:

  • How to extract data from Twitter
  • How to write a DAG script
  • How to load data into a database
  • How to use Airflow Operators

Apache Airflow is an easy-to-use orchestration tool making it easy to schedule and monitor data pipelines. With your knowledge of Python, you can write DAG scripts to schedule and monitor your data pipeline. Code for app written in Python is also included. Good read!

[Read More]

Why and how to replace end-to-end tests with synthetic monitors

Categories

Tags programming cloud tdd miscellaneous performance agile

An older article about potential alternative to classic end-to-end tests: synthetic monitors. A thousand tests can’t prove your software works. They can only prove it doesn’t. When your code reaches production, even the most thorough end-to-end tests can’t prevent your users from seeing that “500 - Unexpected Server Error” screen that keeps you awake at night. By Lucas da Costa.

Author will describe how you can use Elastic’s Synthetic Monitors to help you build software that “works on your machine” and everyone else’s, both before and after your code reaches production. Further in the article:

  • Why can’t end-to-end tests prove your software works and what can you do about it?
  • Writing your first synthetic journeys
  • Running Synthetics Journeys on CI
  • Setting up Synthetic Monitors through Kibana
  • Automatically updating monitors and running tests against multiple environments

Kibana is shipping with many improvements to Elastic’s Synthetics, including, for example, a script recorder, which will make it easier for professionals other than developers to create journeys. Interesting read!

[Read More]

API rate limiting vs. API throttling: How are they different?

Categories

Tags apis cloud devops management

The explosive growth of digital services and mobile devices has created new challenges for developers trying to support users with different needs and usage patterns. High user demand, limited network data plans, and user frustration all combine to create a need for API throttling. By Vyom Srivastava.

Further in the article:

  • What is API throttling?
  • What is API Rate limiting?
  • Similarities Between API rate limiting and API throttling
  • Differences between API throttling and rate limiting
  • Common mistake: Misunderstanding throttling and rate limiting
  • When to implement API rate limiting vs. API throttling

APIs play a critical role in modern software development, so it is important to manage their usage and performance. In the simplest form of API throttling, the throttler would be part of the API server, and it would monitor the number of API requests per second and minute, per user, or per IP address based on user authentication. Rate limiting, on the other hand, is the practice of limiting the number of requests that can be made to an API within a specific time period. Good read!

[Read More]

How IBM's new supercomputer is making AI foundation models more enterprise-budget friendly

Categories

Tags ibm cloud management

Foundation models are changing the way that artificial intelligence (AI) and machine learning (ML) are able to be used. All that power comes with a cost though, as building AI foundation models is a resource-intensive task. By Sean Michael Kerner.

IBM announced that it has built out its own AI supercomputer to serve as the literal foundation for its foundation model–training research and development initiatives. Named Vela, it’s been designed as a cloud-native system that makes use of industry-standard hardware, including x86 silicon, Nvidia GPUs and ethernet-based networking.

IBM is no stranger to the world of high-performance computing (HPC) and supercomputers. One of the fastest supercomputers on the planet today is the Summit supercomputer built by IBM and currently deployed in the Oak Ridge National Laboratory.

The Vela system, however, isn’t like other supercomputer systems that IBM has built to date. For starters, the Vela system is optimized for AI and uses x86 commodity hardware, as opposed to the more exotic (and expensive) equipment typically found in HPC systems. Interesting read!

[Read More]

Write reusable code for AppSync JavaScript resolvers

Categories

Tags nodejs javascript aws frontend apis database

Learn how to share code between AppSync JS resolvers. AWS AppSync is a fully managed service that allows developers to build scalable and performant GraphQL APIs. It is also serverless, meaning that you will only pay for what you use. By Benoît Bouré.

This tutorial is straightforward and covers:

  • Pre-requisites and Assumptions
  • Let’s get started
  • Testing

The introduction of AppSync JavaScript resolvers was a game-changer. They let developers write code quicker in a language they are more familiar with. They also open the possibility to write reusable code more easily. In this article, I showed you how to write simple helper functions that you can use in more than one resolver while still following AppSync’s rules. The code examples are also included. Good read!

[Read More]

The first 30 days as a CTO or VP of Engineering for SaaS: What you need to know

Categories

Tags cio cloud miscellaneous how-to teams career

Starting a new leadership position can be both exciting and daunting, especially if you’re taking over a product or team that you know little about. The first 30 days are critical for setting the tone and direction of your leadership and establishing credibility with your team and other stakeholders. In this post, we’ll provide a roadmap for surviving and thriving in the first 30 days as a new CTO or VP of Engineering. By Zack Schwartz.

Before diving into your new role as CTO or VP of Engineering for a product or team, it’s essential to gather all the necessary information and assess the situation at hand. Are you stepping into a well-oiled machine where your role is to set a product vision? Further in the article:

  • Fact finding mission
  • Mock tech due diligence
  • Identify the key players
  • Building relationships
  • Defining priorities
  • Developing a plan
  • Communicating effectively

It’s always a bit daunting stepping in as a leader of a group that has been working together for a long time and likely know way more than you do about their product. But hopefully this provides some ideas for how you can get started without spinning your wheels. Good luck!

[Read More]

How Web3 and a mesh organizational design can turn challenges into opportunities

Categories

Tags distributed infosec blockchain web-development app-development

We’re in a new era (or at least the early days of a new chapter)—not just a new period in our technological history but also a new paradigm for how people work and contribute to solving problems. One significant challenge I’ve found in working with leaders is that most organizations are not designed to adapt—let alone thrive—in this new era. By Jen Kelchner.

With the rapid emergence of Web3 technologies and the rise of open source software as the basis for these advances, author sees multiple challenges every organization can turn into epic opportunities immediately. This article then explains:

  • What is Web3?
  • Challenge 1: Distributed workforce and systems without an updated organizational model
  • Opportunity: Improve autonomy, resilience, and adaptability through decentralization
  • Challenge 2: When trapped and untapped value exists, it can limit the growth and development of the organization
  • Opportunity: Releasing the regenerative value of capabilities and capacities
  • Challenge 3: It’s all so new and overwhelming
  • Opportunity: Gain insights from data, establish trust, and build the future
  • An open and regenerative organizational culture can optimize the benefits of decentralization

Open approaches tend to espouse granularity, flexibility, and reusability. Open source cultural practices organize around transparency, participation, and community. The open organization characteristics, for example, elevate the idea of people coming together to actively participate and co-create in a community. Nice one!

[Read More]

Encrypt and decrypt data in Node.js using aes-256-cbc

Categories

Tags infosec nodejs web-development how-to app-development

This tutorial aims at teaching you how to encrypt and decrypt data in Node.js. The method provided here is pretty straightforward and easy to understand, as it has been written with the intention of enabling other programmers and developers to learn how to encrypt data in their applications. By Ugbem Job.

In this tutorial, the Encryption and Decryption methods provided are based on the AES-256 algorithm, and why we are using this because it is one of the most popular encryption algorithms in use today, and it’s well known for being secure.

The article is split in:

  • Prerequisites
  • Getting started
  • Installing dependencies
  • Creating the config file
  • Creating the server file
  • Creating the encryption module
  • Testing the API

.. and more. In this tutorial, you learned how to create an API that encrypts and decrypts data using Node.js and Express. You also learned how to use the crypto module to encrypt and decrypt data. Good read!

[Read More]