# Oct 10, 2024

## Addition Is All You Need for Energy-Efficient Language Models

- The **L-Mul algorithm** approximates floating point multiplication using a single integer adder, achieving **higher precision** while significantly reducing computational resources compared to traditional methods. [Link to article](https://arxiv.org/abs/2410.00907)

## Chemistry Nobel: Computational protein design and protein structure prediction

- **David Baker** receives half of the **2024 Nobel Prize in Chemistry** for his groundbreaking work in **computational protein design**, while **Demis Hassabis** and **John M. Jumper** share the other half for their development of **AlphaFold2**, an AI model that predicts protein structures.

- The **2024 Nobel Prize in Chemistry** recognizes **Google DeepMind's AlphaFold** for its groundbreaking contributions to protein folding, highlighting the transformative impact of AI in scientific research.

## Jurgen Schmidhuber on 2024 Physics Nobel Prize

- The **2024 Physics Nobel Prize** highlights significant issues of **plagiarism and incorrect attribution** in computer science, particularly regarding the **Hopfield network** and the **Boltzmann Machine**, which overlook foundational contributions by Shun-Ichi Amari and others.

## Show HN: FinetuneDB – AI fine-tuning platform to create custom LLMs

- **FinetuneDB** enables rapid training of AI models with user data, achieving enhanced performance in **minutes** rather than weeks, while also reducing costs significantly.

## Quantum Advantage for NP Approximation

- **Quantum algorithm DQI shows promise** for outperforming classical heuristics in NP-hard optimization problems, specifically achieving a better approximation ratio for the Optimal Polynomial Intersection problem than any known classical algorithm, with a ratio of approximately **0.7179** compared to the classical best of **0.55**.

## End-to-End Encrypted Cloud Storage in the Wild: A Broken Ecosystem

- **End-to-end encrypted (E2EE) cloud storage is compromised**: A cryptographic analysis reveals severe vulnerabilities across major providers like Sync, pCloud, and Seafile, allowing malicious servers to inject files, tamper with data, and access plaintext information.

## nGPT: Normalized Transformer with Representation Learning on the Hypersphere

- The **normalized Transformer (nGPT)** architecture employs **unit norm normalization** for all vectors, enabling faster learning and reducing training steps by a factor of **4 to 20** compared to traditional methods.

## Intelligence at the Edge of Chaos

- **Intelligent behavior** in artificial systems emerges from the **complexity of rule-based systems**, with our study on elementary cellular automata (ECA) revealing that higher complexity correlates with enhanced model performance on reasoning tasks and chess move predictions.

## Rodimus*: Breaking the Accuracy-Efficiency Trade-Off with Efficient Attentions

- **Rodimus** introduces a **data-dependent tempered selection (DDTS)** mechanism within a linear attention framework, achieving **significant accuracy** while reducing memory usage, thus addressing the computational costs of traditional softmax attention in LLMs.

## LLM Self-Correction with DeCRIM: Decompose, Critique, and Refine for Enhanced Following of Instructions with Multiple Constraints

- **DeCRIM** enhances LLMs' instruction-following capabilities by **decomposing** complex requests into manageable constraints, allowing for targeted refinement and improved performance.

## Flux and Furious: New Image Generation Model Runs Fastest on RTX AI PCs and Workstations

- **Black Forest Labs' FLUX.1 models** leverage the diffusion transformer architecture, achieving high-quality image generation with **12 billion parameters**, optimized for **NVIDIA RTX GPUs** to ensure peak performance.

## Cellular Automaton-Driven Mirrored Tensor Surface for Structured Perturbation in Neural Networks: A Novel Approach to Dynamic Regularization, Enhanced Plasticity, and Multi-Scale Learning through Continuous State-Based Weight Modulation

- **Cellular automaton-driven weight perturbation** introduces a structured approach to neural network optimization, enhancing **dynamic regularization** and **multi-scale learning** through continuous state modulation of weights.

## ML Expert opinion for Paper Review in Cancer research

- **Recent studies** highlight the application of **ML models** in managing **Tumor Lysis Syndrome (TLS)**, prompting a call for expert insights on enhancing their effectiveness and integration into clinical practice.