Tag: Big data
-
How to orchestrate an ETL Data Pipeline with Apache Airflow
Posted on March 10, 2023, Level intermediate Resource Length medium
Data Orchestration involves using different tools and technologies together to extract, transform, and load (ETL) data from multiple sources into a central repository. By Aviator Ifeanyichukwu.
Tags apache database nosql data-science python big-data
-
How to transform time series for deep learning
Posted on February 26, 2023, Level intermediate Resource Length long
Forecasting with deep neural networks. A time series is a sequence of values ordered in time. So, it needs to be transformed for supervised learning. By Vitor Cerqueira.
Tags machine-learning app-development data-science how-to big-data iot
-
Temporal graph neural networks with Pytorch - How to create a simple recommendation engine on an Amazon dataset
Posted on February 11, 2023, Level beginner Resource Length long
Over the course of the last few months, we at Memgraph have been working on something that we believe could be helpful with classical graph prediction tasks. With our latest newborn query module, you will have the option of performing both label classification and link prediction. By Antonio Filipovic.
Tags cloud big-data devops data-science python
-
Data integration vs. data ingestion: What are the differences?
Posted on February 5, 2023, Level intermediate Resource Length medium
Data integration and data ingestion are two IT disciplines that are often confused with one another. Here's how they differ and the challenges you may encounter. By Aminu Abdullahi.
Tags big-data cio data-science machine-learning
-
Building more efficient data infrastructure for machine learning
Posted on December 17, 2022, Level intermediate Resource Length medium
The current influx of data — structured, semi-structured, and unstructured — being driven by an array of data sources is fueling opportunities to leverage machine learning to extract insights and accelerate innovations that can transform businesses and industries. As these data volumes continue to rise, companies are struggling with the complicated task of managing this data and figuring out how to harness it for analytics and AI. By Vedant Jain, Denny Lee.
Tags cio open-source big-data data-science machine-learning
-
Neural Networks from scratch with Python code and math in detail
Posted on December 14, 2022, Level beginner Resource Length long
Older article about building neural networks from scratch. From the math behind them to step-by-step implementation coding samples in Python with Google Colab. By Pratik Shukla, Roberto Iriondo.
Tags machine-learning management analytics big-data data-science
-
Full end-to-end deployment of a machine learning algorithm into a live production environment
Posted on November 12, 2022, Level intermediate Resource Length long
Older article will guide you through how to use scikit-learn, pickle, Flask, Microsoft Azure and ipywidgets to fully deploy a Python machine learning algorithm into a live, production environment. By Graham Harrison.
Tags big-data data-science devops
-
Rings of an ancient tree contain a record of Earth's magnetic field reversal
Posted on October 26, 2022, Level beginner Resource Length medium
An ancient Agathis australis tree with rings that document the near-reversal of Earth's magnetic field has been discovered on New Zealand's north island. The tree, which measures 8 feet in diameter and 65 feet in length, was found buried under 26 feet of soil. Carbon dating shows that the tree was alive for 1,500 years and lived between 41,000 and 42,500 years ago. By @ilovetheuniverse.com.ar.
Tags miscellaneous big-data data-science learning
-
NLU 101: Introduction to Natural Language Understanding
Posted on October 11, 2022, Level beginner Resource Length medium
Natural Language Understanding (NLU) is a subtopic of Natural Language Processing. It focuses on "comprehension". NLU deals with users' intents and what they mean instead of what they say. Thus, some people refer to it as Intent Detection or Intent Detector. By picovoice.ai.
Tags data-science app-development big-data
-
Why AI is perfect for mobile apps
Posted on October 2, 2022, Level beginner Resource Length medium
Why AI is the perfect accompaniment to modern mobile app development and how it's already being used to transform the apps we use every day. Artificial intelligence has been breaking into the mobile app development industry and becoming part of more developers' tools in their wheelhouse. This is because AI and machine learning are able to provide many benefits to not only the team building the application but to the end user as well. By @ninetwothree.co.ao.
Tags big-data app-development data-science analytics
-
Deep dive: How AI content generators work
Posted on September 11, 2022, Level beginner Resource Length medium
Artificial intelligence (AI) has been steadily influencing business processes, automating repetitive and mundane tasks even for complex industries like construction and medicine. By Victor Dey.
Tags big-data machine-learning data-science software-architecture
-
Why you absolutely must document your no-code software
Posted on September 4, 2022, Level beginner Resource Length medium
Here's a conceptual framework to help keep your no-code and low-code effort simple, but comprehensive. By Joe Procopio.
Tags software-architecture big-data bots programming data-science devops