Jun 26, 2024

• Testing AMD's Giant MI300X

  • AMD's Radeon Instinct MI300X significantly outperforms NVIDIA's H100 in various benchmarks, marking a pivotal shift in the GPU compute market dominated by NVIDIA due to its CUDA ecosystem and superior hardware.

• Show HN: R2R V2 – A open source RAG engine with prod features

  • R2R is an open-source Retrieval-Augmented Generation (RAG) system, designed to facilitate the transition from local LLM experimentation to scalable, production-ready applications, featuring a RESTful API for ease of integration.

• Show HN: FiddleCube – Generate Q&A to test your LLM

  • FiddleCube offers a solution for generating ideal question-answer datasets for testing, evaluating, and training large language models (LLMs), addressing the need for a dynamic, accurate, and diverse dataset.

• ESM3: Simulating 500 million years of evolution with a language model

  • ESM3, a language model by EvolutionaryScale, simulates 500 million years of evolution, generating functional proteins far from known ones, showcasing its ability to reason over protein sequence, structure, and function.

• Unlocking Continual Learning Abilities in Language Models

  • MIGU, a rehearsal-free and task-label-free method, significantly mitigates catastrophic forgetting in language models by updating only parameters with large output magnitudes in linear layers, based on the unique L1-normalized magnitude distribution observed across different tasks.

• Codebook collapse

  • The model training for quantizing encoder output faces a codebook collapse, where codewords become too similar, complicating robust tokenization.

• Large Language Models are Interpretable Learners

  • Large Language Models (LLMs) combined with symbolic programs, termed LLM-based Symbolic Programs (LSPs), transform raw input into natural language concepts for interpretable decision-making, addressing the trade-off between expressiveness and interpretability in predictive models.

• EvolutionaryScale Debuts With ESM3 Generative AI Model for Protein Design

  • EvolutionaryScale's ESM3 model, leveraging NVIDIA H100 GPUs, introduces a revolution in protein design by enabling detailed analysis of protein sequences, structures, and functions, aiming to accelerate discoveries in fields like cancer treatment and environmental sustainability.

• Research Focus: Week of June 24, 2024

  • RENC, a system designed by Microsoft researchers, significantly reduces CPU power consumption in 5G vRAN servers by up to 45% by dynamically adjusting CPU frequency based on cellular workload variations, demonstrating a blend of innovative techniques for energy efficiency. Read the paper

• YannicKilcher - Hallucination-Free? Assessing the Reliability of Leading AI Legal Research Tools (Paper Explained)

  • Researchers from Stanford and Yale have critically evaluated the accuracy of AI legal research tools, focusing on their propensity for "hallucinations"—the tendency to generate incorrect or misleading information.

• OS Mass Document Analytics with LlamaIndex Index

• Predicting the Big Five Personality Traits in Chinese Counselling Dialogues Using Large Language Models

  • Large Language Models (LLMs) can predict the Big Five personality traits from counseling dialogues, introducing an innovative framework that leverages role-play and questionnaire-based prompting.

• Measuring and Benchmarking Large Language Models' Capabilities to Generate Persuasive Language

  • Researchers have developed a new dataset, Persuasive-Pairs, to study and benchmark the ability of Large Language Models (LLMs) to generate persuasive text across various domains, enhancing our understanding of LLMs' capabilities in this area.

• LLM Targeted Underperformance Disproportionately Impacts Vulnerable Users

  • Research reveals that state-of-the-art Large Language Models (LLMs) exhibit undesirable behaviors such as hallucinations and bias, more frequently affecting users with lower English proficiency, lower education levels, and those from outside the US.

• LLM-ARC: Enhancing LLMs with an Automated Reasoning Critic

  • LLM-ARC enhances Large Language Models' logical reasoning by integrating with an Automated Reasoning Critic (ARC), employing an Actor-Critic method for generating and refining declarative logic programs.