Streaming data

Streaming data is data that is continuously generated by different sources. Such data should be processed incrementally using Stream Processing techniques without having access to all of the data. In addition, it should be considered that concept drift may happen in the data which means that the properties of the stream may change over time.

It is usually used in the context of big data in which it is generated by many different sources at high speed.[1][2]

Data streaming can also be explained as a technology used to deliver content to devices over the internet, and it allows users to access the content immediately, rather than having to wait for it to be downloaded.[3] Big data is forcing many organizations to focus on storage costs, which brings interest to data lakes and data streams.[4] A data lake refers to the storage of a large amount of unstructured and semi data, and is useful due to the increase of big data as it can be stored in such a way that firms can dive into the data lake and pull out what they need at the moment they need it.[4] Whereas a data stream can perform real-time analysis on streaming data, and it differs from data lakes in speed and continuous nature of analysis, without having to store the data first.[4]

  1. ^ "What is Streaming Data?".
  2. ^ "Streaming Data: Big Data at High Velocity". 8 August 2016.
  3. ^ Costello, Sam. "Internet Streaming: What It Is and How It Works". Lifewire.
  4. ^ a b c Rossi, Ben (June 2016). "Data lakes vs data streams: which is better?". Information Age.

Powered by 654 easy search