# Apr 20, 2025

---

## Pushing the Limits of LLM Quantization via the Linearity Theorem
- The **linearity theorem** establishes a direct link between layer-wise **$\ell_2$ reconstruction error** and model **perplexity increase**, paving the way for innovative quantization methods.

## Gemma 3 QAT Models: Bringing AI to Consumer GPUs
- **Gemma 3 QAT models** leverage **Quantization-Aware Training (QAT)** to optimize performance on consumer GPUs, enabling powerful AI capabilities on devices like the NVIDIA RTX 3090 with significantly reduced memory requirements.

## Packing Input Frame Context in Next-Frame Prediction Models for Video Generation
- **FramePack** enables the diffusion of **thousands of frames** at **full fps-30** using **13B models** on a **6GB laptop GPU**, showcasing its efficiency in resource management.

## How to Write a Fast Matrix Multiplication from Scratch with Tensor Cores (2024)
- **Optimized matrix multiplication** using Tensor Cores on NVIDIA Tesla T4 GPUs can achieve up to **96% of cuBLAS throughput** for large matrices, demonstrating significant performance improvements through techniques like hierarchical tiling, swizzling, and double buffering.

## Jagged AGI: o3, Gemini 2.5, and everything after
- **New AI models** like o3 and Gemini 2.5 demonstrate significant advancements in capabilities, enabling complex tasks such as generating marketing plans and analyzing data with minimal prompts.

## New Proof Settles Decades-Old Bet About Connected Networks
- A **new proof** has confirmed that both Peter Sarnak and Noga Alon were incorrect about the prevalence of optimal expander graphs, revealing that approximately **69%** of random regular graphs are Ramanujan graphs, which are highly interconnected yet have few edges.

## Translate Fortran to C++ with AI and RAG
- **AI and large language models (LLMs) are being utilized to translate millions of lines of Fortran code into C++, enhancing compatibility with modern computing systems.** This initiative, led by Dan O'Malley and his team at LANL, aims to mitigate the risks associated with reliance on outdated programming languages.

## [R] Biologically-inspired architecture with simple mechanisms shows strong long-range memory (O(n) complexity)
- The new **biologically-inspired architecture** demonstrates **strong long-range memory** capabilities with **O(n)** time and memory complexity, achieved through simple mechanisms akin to signal accumulation.

## [R] Unifying Flow Matching and Energy-Based Models for Generative Modeling
- **Flow Matching and Energy-Based Models** unify to create a **dynamic generative model** that transitions from noise to data using optimal transport paths, enhancing the likelihood structure of the data manifold.

## Researchers develop picosecond-level flash memory device
- **Researchers have developed a new flash memory device** that promises to enhance data storage efficiency and speed, potentially revolutionizing the tech industry. [Link to article](https://www.fudan.edu.cn/en/2025/0417/c344a145016/page.htm)

## [D] Gemini 2.5 Flash Reasoning vs Non reasoning Experiments
- **Gemini 2.5 Flash** demonstrates surprising efficacy, providing correct answers even in **non-thinking mode** for complex prompts typically requiring high reasoning budgets, suggesting its robustness across various domains like math and coding.

## [R] Hey there! I made a research proposal for a master programme application and I want some opinion about it. I wanted to develop an emotion embedded AI model that can generate back response to the recipients
- The proposed **emotion-aware AI system** aims to integrate **facial cues, speech features, physiological signals (EEG)**, and context to enhance **empathetic human-computer interaction (HCI)**, moving beyond mere accuracy to reflect human decision-making processes.