Building a Cybersecurity News Aggregator: Story Clustering, Seven Importance Signals and Strict Filtering Thresholds

The idea for an information security news aggregator emerged years ago with the goal of delivering only the most relevant stories while eliminating noise. Early versions relied on the rut5_base_sum_gazeta summarization model and TextRank for importance scoring, but performance remained unsatisfactory. The current system processes roughly one thousand items daily from more than 200 sources and publishes only about 0.5 percent of them. A hybrid approach now combines a transparent seven-feature formula that scores story importance with an LLM that removes irrelevant content and generates concise summaries. The formula incorporates signals such as confirmation count, CVSS severity, exploitation status from KEV, source tier, proximity to Russian readers, depth of analysis, and publication speed. Penalties are applied for vendor self-promotion, webinars, and job postings. Stories are clustered using CVE identifiers, shared trigrams, and named entities to avoid duplicate posts while preserving original reporting.

HabrTranslated from Russian

Read at source

The concept of a dedicated information security news aggregator originated several years ago. The objective was to receive only the most important developments without information noise.

Initial implementations used the rut5_base_sum_gazeta summarization model together with TextRank for importance ranking, yet results were inconsistent. Later commercial services that curate feeds still failed to balance breadth and relevance, often covering either everything or only narrow topics.

After weeks of prompt tuning proved ineffective, a hybrid architecture was adopted. Importance is now calculated by a formula consisting of seven explicit, logged features whose weights can be inspected and adjusted. A language model performs two supporting tasks: filtering out non-relevant items and generating readable text.

Core data flow and filtering funnel

Approximately one thousand materials arrive daily from more than 200 sources. Only around 0.5 percent reach publication. The first stage applies the seven-feature formula; the second stage uses the model to discard irrelevant content.

Seven importance features

  • Confirmation – number of independent outlets covering the same event
  • Severity – CVSS score above 9 receives maximum weight; active exploitation in the wild grants full weight regardless of CVSS
  • Primary source – presence of a CERT, KEV catalog entry, or original vendor research
  • Reader proximity – Russian company or Russian-context stories receive higher weight
  • Analysis depth – detailed technical breakdowns and novel attack classes score higher
  • Authority – best source tier present in the cluster (primary, research, security media)
  • Speed – time between first and last publication; one post per hour or faster earns full points

Penalties are subtracted for vacancies, webinars, awards, and vendor self-promotion unless an independent outlet later confirms the story.

Story clustering methods

Materials describing the same incident are merged into a single story using three decreasingly strict techniques: shared CVE, GHSA, Microsoft KB or BDU identifiers; overlapping trigrams within the same language; and shared named entities such as Microsoft, SharePoint or Fortinet that link Russian and English reports.

Meridian digestThe week's most consequential security stories, distilled into one briefing.See the digest

More in Other

Mail.ru Reduces Lifetime 1TB Cloud Storage Promo to Standard 8GB Quota for Select Users
Kimi K3 Open Model Surpasses Closed AI Leaders with Million-Token Context and 896 Experts
Innostage Completes Functional Testing of PT NGFW 1.10.3 Across 156 Criteria