Data stream

This article is about the more general meaning of the term "data stream". For the UK-specific DSL technology, see Datastream.

Not to be confused with Stream (computing) or Bitstream.

In connection-oriented communication, a data stream is the transmission of a sequence of digitally encoded signals to convey information. Typically, the transmitted symbols are grouped into a series of packets.

Data streaming has become ubiquitous. Anything transmitted over the Internet is transmitted as a data stream. Using a mobile phone to have a conversation transmits the sound as a data stream.

Formal definition

In a formal way, a data stream is any ordered pair $(s,\Delta )$ where:

1. $s$ is a sequence of tuples and
2. $\Delta$ is a sequence of positive real time intervals.

Content

Data Stream contains different sets of data, that depend on the chosen data format.

• Attributes – each attribute of the data stream represents a certain type of data, e.g. segment / data point ID, timestamp, geodata.
• Timestamp attribute helps to identify when an event occurred.
• Subject ID is an encoded-by-algorithm ID, that has been extracted out of a cookie.
• Raw Data includes information straight from the data provider without being processed by an algorithm nor human.
• Processed Data is a data that has been prepared (somehow modified, validated or cleaned), to be used for future actions.

Usage

There are various areas where data streams are used:

• Fraud detection & scoring – raw data is used as source data for an anti-fraud algorithm (data analysis techniques for fraud detection). For example, timestamps, cookie occurrences or analysis of data points are used within the scoring system to detect fraud or to make sure that a message receiver is not a bot (so-called Non-Human Traffic).
• Artificial intelligence – raw data is treated like a train set and a test set during AI and machine learning algorithms building.
• Raw data is used for profiling and personalization to customize user profiles and divide them for segmentation, e.g., per gender or location (based on data point).
• Business intelligence – raw data is a source of information for BI systems, used for enriching user profiles with detailed information about them, e.g., purchase path or geodata. This information is used for business analysis and predictive research.
• Targeting – processed data by data scientists improve online campaigns and is used for reaching the target audience.
• CRM Enrichment – raw data is integrated with customer-relationship management system. CRM integration allows to fill the gaps in users' profiles with demographic data, interests or buying intentions.

Integration

Core integrations with data streams are:

• Data streams are integrated with systems such as customer data platform (CDP), customer relationship management (CRM) or data management platform (DMP) to enrich users' profiles with external data. It is possible to expand the knowledge about existing users by using external sources.
• Data streams are used to enrich business intelligence systems and make analysis more precise and conclusions more accurate.
• In the case of content management system (CMS) integration, Data Stream is used to identify the users and personalize their visit, even if it's their first one. By data analysis, the actual content of the website is adapted to the user.
• Data streams are integrated with demand side platform (DSP) within programmatic advertising ecosystem. Parties (e.g., advertisers) can exchange the users' IDs and concatenate with them existing profiles.
• Data streams are used to choose respective user segments (e.g., people interested in the automotive industry) and use them in an online campaign. Segments are enriched with more user characteristics out of data stream and then sent to DSP.

Data sources visible

In a data stream it is visible what device has been used by the user side – it is visible on user agent:

• mobile – when a user uses a mobile browser to explore, it has narrow screen resolution and mobile app version, respectively;
• desktop – when a user uses a desktop browser or app version.

The following information is shared out of used device:

• Actual URL to the visited website, where an event occurred
• User Agent
• Geolocation
• Internet Protocol (IP)

Formats

A data point is a tag that collects information about a certain action, performed by a user on a website. Data points exists in two types, the values of which are used to create appropriate audiences. Those are:

• 'event' with information about occurrences of the specific event (e.g., click on a link or displaying ad)
• 'attribute' with numerical or alphanumerical values.

Segment is a logical statement, built on specific Data Points using AND, OR or NOT operators.
Hybrid data – raw data out of both Data Point and Segment data formats.
URLs – is a set of information about a particular URL that has been visited.

GDPR

Information gathered out of websites are based on user behavior. Data providers deliver both personal or non-personal information. There are two types of user data available in data stream:

• Personally identifiable information (PII) – information that allows clearly or by combining with data identification methods identify a person. Examples of PII are: insurance ID, email address, phone number, IP address, geolocation, biometric data.
• Non-personally identifiable information (non-PII) is information that can't be used to identify a person or to track a location. A cookie or a device ID is an example of non-PII.

See also

• Streaming algorithm