Zscaler Report Details How Generative AI Accelerates Custom Malware Creation and Social Engineering

Zscaler published an analysis on October 16 examining the use of generative AI by attackers for social engineering, data discovery, and malware development. Principal security researcher Phil Hagen notes that the report focuses on broad methods rather than naming specific malware families or confirmed campaigns. The core observation centers on the dramatically increased speed at which malicious scripts can be written and iteratively revised. Traditional detection that relies on matching files or traffic against known patterns loses effectiveness when code is frequently altered while preserving the same functionality. The analysis clarifies that observed rapid creation and revision does not equate to fully autonomous self-mutating malware that changes on every execution. Another impact is the disappearance of classic indicators such as spelling and grammar errors in phishing messages, which previously helped identify malicious intent. Zscaler recommends focusing on behavioral analysis of what programs actually do rather than solely relying on matches to previously catalogued samples.

BoletimSecTranslated from Portuguese

Read at source

Zscaler published an analysis on October 16 examining how cybercriminals are applying generative AI to social engineering, data discovery, and malware development. The report was authored by Phil Hagen, principal security researcher at the company.

The document describes broad techniques rather than identifying any named malware family or confirmed campaign. Its central theme is the speed with which malicious scripts can now be created and revised, and the resulting challenges for defenders.

Traditional detection compares files and network traffic against previously known patterns. When attackers rapidly alter code while maintaining the same outcome, these comparisons become far less reliable. Rules built from older samples lose value against newly generated code that has not yet been catalogued.

The report explicitly states that the observed activity does not demonstrate fully autonomous self-mutating malware. What Zscaler documented is rapid human-driven creation and revision, not an automatic mutation mechanism that activates on every execution.

A secondary effect is the loss of a classic detection signal. Messages produced by language models contain no spelling or grammar errors that once flagged phishing attempts. Some of these messages persuade users to install remote monitoring and management software. Once installed, attackers gain control of the system and can move laterally using legitimate tools.

In ransomware operations, the interval between initial access and data theft followed by encryption has shortened. Smaller groups now possess development capabilities comparable to those of larger organizations, reducing the value of unique tooling as an indicator of attacker identity or resources.

Zscaler recommends that defenders evaluate program behavior rather than relying primarily on matches to known samples.

Meridian digestThe week's most consequential security stories, distilled into one briefing.See the digest

More in AI Security

Logical Argument Claims Full Alignment of Superintelligent AGI Is Fundamentally Impossible
Claude Account Bans Linked to IP Reputation, Device Environment and Payment Channels, But No Confirmed Formula
Local LLMs in AppSec: What Open Tools and Models Can Handle in Application Security