Processing of streaming data with keyed aggregation
a technology of streaming data and keyed aggregation, applied in the field of processing streaming data, can solve the problems of excessive amount of data processed, excessive amount of resources consumed, and overwhelming amount of data output by these systems
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Benefits of technology
Problems solved by technology
Method used
Image
Examples
Embodiment Construction
[0019]In accordance with an aspect of the present invention, a capability is provided for improving processing of streaming data by employing a keyed aggregation operator that uses replacement of older information with more recent information. A capability is provided for aggregating the values from a stream of data events, in which, for example, there is a flow of events (i.e., records) where some events are for the same entity as previous events and they replace the older events (i.e., records related to an entity received earlier), and these replaced events no longer factor in the aggregation calculations.
[0020]As one example, in order to incrementally calculate aggregations even in light of events for specific entities being replaced by newer events for those entities, the most recent event for each unique replacement key value(s) is maintained, running aggregations are kept, and the aggregations are output. When a new event arrives, in one example, if a previous event exists for t
PUM
Abstract
Description
Claims
Application Information
- R&D Engineer
- R&D Manager
- IP Professional
- Industry Leading Data Capabilities
- Powerful AI technology
- Patent DNA Extraction
Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.
© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap