Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Importance of Small Probability Events in Big Data: Information
  Measures, Applications, and Challenges   In many applications (e.g., anomaly detection and security systems) of smart
cities, rare events dominate the importance of the total information of big
data collected by Internet of Things (IoTs). That is, it is pretty crucial to
explore the valuable information associated with the rare events involved in
minority subsets of the voluminous amounts of data. To do so, how to
effectively measure the information with importance of the small probability
events from the perspective of information theory is a fundamental question.
This paper first makes a survey of some theories and models with respect to
importance measures and investigates the relationship between subjective or
semantic importance and rare events in big data. Moreover, some applications
for message processing and data analysis are discussed in the viewpoint of
information measures. In addition, based on rare events detection, some open
challenges related to information measures, such as smart cities, autonomous
driving, and anomaly detection in IoTs, are introduced which can be considered
as future research directions.

30
The categories of this paper are: q-alg
9
The categories of this paper are: nlin
35
The categories of this paper are: mtrl-th
13
The categories of this paper are: quant-ph
3
The categories of this paper are: physics
29
The categories of this paper are: funct-an
12
The categories of this paper are: nucl-th
17
The categories of this paper are: q-fin
37
The categories of this paper are: supr-con
36
The categories of this paper are: cmp-lg
4
The categories of this paper are: cond-mat
25
The categories of this paper are: patt-sol
32
The categories of this paper are: atom-ph
14
The categories of this paper are: math-ph
28
The categories of this paper are: alg-geom
11
The categories of this paper are: hep-lat