Deep Self-Supervised Clustering of the Dark Web for Cyber Threat Intelligence

In recent years, cyberattack techniques have become more and more sophisticated each day. Even if defense measures are taken against cyberattacks, it is difficult to prevent them completely. It can also be said that people can only fight defensively against cyber criminals. To address this situation, it is necessary to predict cyberattacks and take appropriate measures in advance, and the use of intelligence is important to make this possible. In general, many malicious hackers share information and tools that can be used for attacks on the dark web or in the specific communities. Therefore, we assume that a lot of intelligence, including this illegal content exists in cyber space. By using the threat intelligence, detecting attacks in advance and developing active defense is expected these days. However, such intelligence is currently extracted manually. In order to do this more efficiently, we apply machine learning to various forum posts that exist on the dark web, with the aim of extracting forum posts containing threat information. By doing this, we expect that detecting threat information in cyber space in a timely manner will be possible so that the optimal preventive measures will be taken in advance.

[1]  Hsinchun Chen,et al.  Exploring the online underground marketplaces through topic-based social network and clustering , 2016, 2016 IEEE Conference on Intelligence and Security Informatics (ISI).

[2]  Ahmad Diab,et al.  Darknet and deepnet mining for proactive cybersecurity threat intelligence , 2016, 2016 IEEE Conference on Intelligence and Security Informatics (ISI).

[3]  Masashi KADOGUCHI,et al.  Exploring the Dark Web for Cyber Threat Intelligence using Machine Leaning , 2019, 2019 IEEE International Conference on Intelligence and Security Informatics (ISI).

[4]  Hsinchun Chen,et al.  IEDs in the Dark Web: Genre classification of improvised explosive device web pages , 2008, 2008 IEEE International Conference on Intelligence and Security Informatics.

[5]  Hsinchun Chen IEDs in the dark web: Lexicon expansion and genre classification , 2009, 2009 IEEE International Conference on Intelligence and Security Informatics.