Search-R1: Training LLMs to Reason and Leverage Search Engines with RL
Search-R1 enhances large language models (LLMs) by enabling them to autonomously generate search queries through reinforcement learning (RL), improving reasoning and text generation capabilities.
AI 2027
Superhuman AI's impact by 2027 is predicted to surpass that of the Industrial Revolution, driven by advancements from companies like OpenBrain, Google DeepMind, and Anthropic, all of which anticipate the arrival of AGI within five years.
Multi-Token Attention
Multi-Token Attention (MTA) enhances LLMs by allowing simultaneous conditioning on multiple query and key vectors, overcoming the limitations of traditional single token attention.
How Google built its Gemini robotics models
Gemini Robotics models enable robots to learn complex tasks such as preparing salads and performing a "slam dunk" on their first attempt, showcasing a significant leap in robotic capabilities.
Apple's Cubify Anything: Scaling Indoor 3D Object Detection
Cubify Anything introduces the Cubify Transformer (CuTR) and the CA-1M dataset, enhancing indoor 3D object detection with extensive annotations and ground-truth data for improved model training and evaluation.
Tenstorrent Launches Blackhole Developer Products at Tenstorrent Dev Day
Tenstorrent unveiled the Blackhole™ chip family, featuring new RiscV cores designed for massive AI workloads and offering an infinitely scalable solution for developers.
Search could be so much better. And I don't mean chatbots with web access
MatterRank revolutionizes search by allowing users to dictate how results are ranked, moving beyond traditional keyword-based systems to a more personalized experience.
Neuron-based explanations of neural networks sacrifice completeness and interpretability (TMLR 2025)
Neuron-based explanations of neural networks often lack completeness and interpretability, as demonstrated by the finding that principal components yield superior insights.
Speed Demon: NVIDIA Blackwell Takes Pole Position in Latest MLPerf Inference Results
NVIDIA Blackwell achieved record-breaking performance in the latest MLPerf Inference V5.0, showcasing the GB200 NVL72 system with up to 30x higher throughput on the Llama 3.1 405B benchmark compared to previous submissions.
Multi-Token Attention: Enhancing Transformer Context Integration Through Convolutional Query-Key Interactions
Multi-Token Attention enhances transformer models by employing key-query convolution, allowing simultaneous processing of multiple tokens, which overcomes the limitation of independent token attention in standard transformers.
Relevance of Minimum Description Length to understanding how Deep Learning really works
Minimum Description Length (MDL) offers insights into the underlying mechanisms of deep learning, addressing phenomena like overparameterization and double descent that remain poorly understood.
Open-data reasoning model, trained on curated supervised fine-tuning (SFT) dataset, outperforms DeepSeekR1. Big win for the open source community
The OpenThinker2-32B model has successfully surpassed DeepSeek-32B, demonstrating that a larger dataset can significantly enhance performance, with 1 million high-quality SFT examples now available for open-source use.
Mirrors: The Blind Spot of Image and Video Generation Models
AI models struggle with mirror reflections, often producing distorted or incorrect images, indicating a significant blind spot in generative image and video synthesis.
Patronus AI, Columbia University and Meta release BLUR benchmark for tip-of-the-tongue retrieval evaluation for agents
BLUR is a benchmark for tip-of-the-tongue search and reasoning, featuring 573 real-world questions that require advanced multi-modal and multilingual processing, with human performance averaging 98% accuracy compared to the best AI system at 56%.
What are the current challenges in deepfake detection (image)?
Current challenges in deepfake detection include the need for improved dataset generalization and the identification of specific problems that remain unsolved, particularly in image detection.