PyTorch

Raft Develops Multilabel Guardrail Classifier Detecting 15 Risk Categories with 3x Speed and Cost Gains

Raft has released details on a custom multilabel guardrail classifier designed to scan both incoming prompts and model outputs for 15 distinct risk categories in real time. The system handles Russian and English text while maintaining independent thresholds for each category to balance false positives against critical misses. By switching from a PyTorch baseline to TensorRT inference on NVIDIA RTX 3090 hardware, the team achieved a 2.95x reduction in single-request latency and lowered inference cost to $0.062 per million requests. The architecture uses per-category expert query tokens plus a lightweight interaction transformer to capture correlations such as those between armament and violent content. Training relied on asymmetric loss functions and post-epoch per-class threshold tuning rather than standard binary cross-entropy. Benchmarking against nine open guardrail and toxicity models showed superior macro-F1 on rare but high-impact categories while remaining an order of magnitude cheaper than external LLM judges.

Reversing MD5 Hash Function from 2500-Layer Neural Network in Jane Street CTF Puzzle

A Jane Street machine learning puzzle challenged participants to reverse-engineer a PyTorch model containing 2500 layers and recover an MD5 computation solely from its integer weights. The network output 0 for nearly all inputs, forcing solvers to use mechanistic interpretability instead of gradient-based search. Alex, a graduating student, identified that the final layers performed equality checks on 16-byte values using ReLU activations and crafted linear programming and SAT reductions to simplify the model from two million nodes to 75 thousand. Further analysis revealed the core computation consisted of 32 identical MD5 rounds, with an unintended bug in length encoding for inputs exceeding 32 bytes. The hidden target hash was deliberately chosen to be brute-forceable once the algorithm was identified, and the correct input turned out to be two common English words separated by a space. The exercise demonstrated both the feasibility and the extreme difficulty of extracting algorithmic behavior from large, non-differentiable neural networks.