ML Times
Jun 5, 2026
Daily
When AI Builds Itself: Our progress toward recursive self-improvement
- Anthropic is advancing toward recursive self-improvement, where AI systems autonomously design their successors, potentially revolutionizing AI development and accelerating productivity. This shift allows AI to handle more complex tasks, with Anthropic engineers now merging 8x more code per quarter than in previous years, indicating a significant leap in efficiency.
Gemma 4 QAT models: Optimizing compression for mobile and laptop efficiency
- Gemma 4's new QAT models utilize Quantization-Aware Training to significantly reduce memory requirements and enhance performance on mobile and laptop devices, achieving a memory footprint as low as 1GB for the E2B model.
KVarN: Native vLLM backend for KV-cache quantization by Huawei
- KVarN enhances KV-cache capacity by 3-5x and boosts throughput by ~1.3x while maintaining FP16-level accuracy, making it ideal for long-context workloads and concurrent requests.
Anthropic's open-source framework for AI-powered vulnerability discovery
- Autonomous vulnerability discovery is facilitated through a reference implementation using Claude, designed from insights gained by collaborating with security teams, enabling users to build customized vulnerability detection pipelines.
Redis 8.8: New array data structure, rate limiter, performance improvements
- Redis 8.8 introduces a new array data structure that is dynamic, index-addressable, and optimized for performance, enabling faster access and new use cases in data management.
On-policy distillation: one of the hottest terms on PapersWithCode [R]
- On-policy distillation (OPD) is a pivotal technique in AI, enhancing models like Qwen 3.6 and 3.7, GLM-5.1, and DeepSeek-V4 by refining error correction through targeted hint tokens.
Launch HN: General Instinct (YC P26) – Frontier models on edge devices
- General Instinct has developed InstinctRazor, a tool that compresses the Qwen3.5-122B-A10B model from 245 GB to 48 GiB, enabling it to run efficiently on edge devices while outperforming competitors like Gemma-4-26B-A4B on benchmarks such as MMLU-Pro and GPQA-D.
Inside FAISS: Billion-Scale Similarity Search
- FAISS enables billion-scale similarity search by utilizing approximate methods like IVF and Product Quantization, significantly enhancing search speed while maintaining acceptable accuracy levels.
Sakana AI's Recursive Self-Improvement (RSI) Lab
- Sakana AI’s Recursive Self-Improvement (RSI) Lab aims to revolutionize AI by developing adaptive architectures that autonomously enhance themselves, moving beyond traditional, static models to create a new paradigm of intelligence.
KVarN: Variance-Normalized KV-Cache Quantization [R]
- KVarN introduces a novel KV-Cache quantization method that utilizes Hadamard rotations and variance-normalization on both K and V matrices, achieving 3-4x compression with minimal accuracy loss (0-1%) in decode-heavy tasks.
OPRD: On-Policy Representation Distillation
- On-Policy Representation Distillation (OPRD) enhances distillation by aligning student and teacher representations in hidden-state space, effectively eliminating sampling variance and enriching structural information across layers.
[R] Measuring the Symmetry--Data Exchange Rate
- Equivariance theory suggests that an architectural symmetry prior can significantly reduce sample complexity, yet this study reveals that misaligned constraints can be actively harmful, not just unhelpful, with a joint pairwise confidence interval of [+0.79, +3.26] indicating robust findings.
🤗Nemotron 3.5 Content Safety: Customizable Multimodal Safety for Global Enterprise AI
- Nemotron 3.5 offers customizable multimodal safety features, enhancing AI content moderation for global enterprises by integrating advanced safety protocols tailored to diverse needs.
🤗EVA-Bench Data 2.0: 3 Domains, 121 Tools, 213 Scenarios
- EVA-Bench Data 2.0 encompasses 3 domains, 121 tools, and 213 scenarios, offering a comprehensive framework for evaluating AI models across diverse applications.
Vortex: Efficient and Programmable Sparse Attention Serving for AI Agents
- Vortex revolutionizes sparse attention by enabling rapid prototyping and deployment of algorithms, achieving up to $3.46\times higher throughput than traditional full attention while maintaining accuracy.