# Jan 13, 2025

- **Transformers** have gained traction in **Computer Vision** since 2020, with the introduction of **Vision Transformers** challenging traditional architectures like **ResNets** for tasks such as image classification.

- **Cosine similarity** has been found to be unreliable due to **arbitrary scaling** introduced by regularization in linear matrix factorization models, which can lead to **meaningless results** in applications like recommendation systems.

- The **2025 AI Engineering Reading List** curates **50 essential papers** across **10 AI fields**, including LLMs, Vision, and CodeGen, aimed at providing practical insights for engineers starting from scratch.

- A **20-line code modification** can significantly enhance A/B testing by implementing a multi-armed bandit approach, allowing for real-time optimization of user interactions on websites.

- **Search-o1** introduces a **novel framework** that enhances large reasoning models by integrating an **agentic retrieval-augmented generation (RAG) mechanism** and a **Reason-in-Documents module** for autonomous knowledge retrieval, addressing the challenge of knowledge insufficiency in long-chain reasoning.

- **VideoRAG** introduces a novel framework that dynamically retrieves relevant videos, enhancing the **Retrieval-Augmented Generation** process by integrating both visual and textual information for improved output generation.

- **Optimizing with looser bounds** on training data can enhance **predictive performance**, particularly in overparametrized neural networks, as noted in the referenced paper [arXiv](https://arxiv.org/pdf/2005.07186).

- **SemHash** offers a novel approach to **semantic text deduplication**, addressing the complexities of duplicate samples that can distort model training and lead to unreliable results, with added **explainability features** for transparency in the deduplication process.

- **LLM-as-a-Judge** framework for hallucination detection outperforms many advanced research methods, with a **CoT (Chain-of-Thought)** prompting achieving an impressive **accuracy of 0.833** on the HaluBench dataset.

- **NVIDIA and IQVIA are developing custom AI agents** using the NVIDIA AI Foundry to enhance drug research, clinical development, and commercialization, ultimately aiming to improve patient outcomes in healthcare and life sciences.

- **AI agents represent a significant evolution in technology**, enabling systems to autonomously perform complex tasks without direct human input, thus shifting from traditional tools to more dynamic, context-aware entities.

- **SEAG** (Semantic Exploration with Adaptive Gating) enhances **efficiency** in language model reasoning by dynamically adjusting tree search based on prior answer confidence, addressing the **computational inefficiencies** of traditional methods.

- The **element-wise attention mechanism** introduces a novel approach that utilizes **element-wise squared Euclidean distance** for similarity computation, significantly enhancing efficiency while maintaining competitive performance compared to traditional self-attention methods.