# Why the deep learning boom caught almost everyone by surprise

- The **deep learning boom** was catalyzed by the **ImageNet dataset**, which contained **14 million images** across **22,000 categories**, enabling neural networks to achieve unprecedented performance in image recognition.

# Tencent Hunyuan-Large

- **Hunyuan-Large** is the largest open-source **Transformer-based Mixture of Experts (MoE)** model, boasting **389 billion parameters** with **52 billion active parameters**, designed to optimize resource consumption while maintaining high performance in AI applications.

# [R] Never Train from scratch

- **Transformers** pre-trained on specific tasks can achieve performance levels comparable to **S4** on the **Long Range Arena benchmark**, demonstrating the effectiveness of transfer learning in machine learning models.

# PiML: Python Interpretable Machine Learning Toolbox

- **PiML Toolbox** is a versatile Python library for interpretable machine learning, featuring both low-code and high-code interfaces, and supports models like **GLM**, **GAM**, and **XGB** with enhanced data handling in its latest release (V0.6.0).

# [D] Evolving Matrix Computation Techniques for Modern AI: What's New?

- **Matrix computation techniques** are evolving to enhance **efficiency** and **adaptability** in AI systems, addressing the increasing complexity and size of modern models.

# [R] Amazon Researchers Find LLMs do not always follow User Requests and Propose a Self-Correction Pipeline

- **Amazon researchers reveal that LLMs, including GPT-4, fail to meet at least one requirement in over 21% of complex user instructions**, highlighting significant limitations in their ability to follow multi-constrained requests effectively.

# 131M American Buildings

- **ORNL's AI-generated US Building Dataset** comprises **131.8 million** unique buildings, offering enhanced metadata compared to existing datasets from Google and Microsoft, which improves accuracy in building footprint representation.

# V-DPO: Mitigating Hallucination in Large Vision Language Models via Vision-Guided Direct Preference Optimization

- **V-DPO** addresses hallucination in **large vision-language models (LVLMs)** by reducing reliance on the **Large Language Model (LLM)** backbone, which often biases outputs due to language priors and insufficient visual context attention.

# SMoA: Improving Multi-agent Large Language Models with Sparse Mixture-of-Agents

- The **SMoA framework** enhances multi-agent Large Language Models (LLMs) by implementing **sparse information flows**, which improves both **efficiency** and **diversity** in agent interactions, addressing limitations of dense connections.

# DroidSpeak: Enhancing Cross-LLM Communication

- **DroidSpeak** introduces a framework that enhances **cross-LLM communication** by reusing intermediate data, significantly reducing prefill-phase latency in multi-agent systems.

# NVIDIA Advances Robot Learning and Humanoid Development With New AI and Simulation Tools

- **NVIDIA's new AI and simulation tools**, including the **NVIDIA Isaac Lab** and **Project GR00T**, aim to enhance robot dexterity and humanoid development, enabling developers to create more sophisticated AI-enabled robots efficiently.

# Hugging Face and NVIDIA to Accelerate Open-Source AI Robotics Research and Development

- **Hugging Face’s LeRobot framework**, integrated with NVIDIA’s AI and robotics technologies, aims to revolutionize robotics research across diverse sectors like manufacturing and healthcare. This collaboration leverages open-source tools to enhance accessibility and innovation in robotics development.

# VERITAS: A Unified Approach to Reliability Evaluation

- **VERITAS** introduces a **family of hallucination detection models** that enhance the reliability of large language models (LLMs) by integrating a robust fact-checking system, addressing the critical need for accuracy in knowledge-intensive applications.

# A Mamba Foundation Model for Time Series Forecasting

- **TSMamba** is a **linear-complexity foundation model** for time series forecasting that excels in zero-shot learning, enabling accurate predictions even with limited training data, thanks to its innovative Mamba architecture.

# TokenSelect: Efficient Long-Context Inference and Length Extrapolation for LLMs via Dynamic Token-Level KV Cache Selection

- **TokenSelect** introduces a **model-agnostic** method for efficient long-context inference, leveraging **dynamic token-level KV cache selection** to enhance performance without the need for training.