# Mar 27, 2024

- **Aqua Voice**, a **voice-native document editor**, revolutionizes dictation by understanding natural language commands and intent, making it a more intuitive tool for writing.

- **DBRX, a new open large language model (LLM) by Databricks, outperforms established models like GPT-3.5 and is competitive with Gemini 1.0 Pro**, especially in programming and general-purpose tasks, leveraging a fine-grained mixture-of-experts architecture for efficiency.

- **Cliff Stoll's investigation** of a minor accounting discrepancy led to the uncovering of the first known case of state-sponsored hacking, detailed in his book _The Cuckoo's Egg_.

- A **new study** reveals that up to **17% of peer reviews** for major AI conferences in 2023-2024 likely contained significant content generated by AI models like ChatGPT, marking a substantial increase from 1-2% in pre-ChatGPT years.

- **Hybrid-Net** is an AI-powered, transformer-based multimodal model designed for real-time **audio source separation**, and generating lyrics, chords, beats, melody, and tabs for any song, enhancing music information retrieval through interdependent network models.

- Amazon's **$2.75 billion investment** in AI startup Anthropic marks its **largest venture investment**, aiming to secure a competitive edge in the burgeoning field of generative artificial intelligence.

- **Claude 3 Opus** outperformed all of OpenAI's models in Aider's code editing benchmark, achieving the highest score with a completion rate of **68.4%** on coding tasks. [Anthropic's announcement](https://www.anthropic.com/news/claude-3-family)

- MIT's **Computer Science and Artificial Intelligence Laboratory** introduces a **new AI tool** that generates high-resolution images **30 times faster** than conventional methods, utilizing a technique called **"distribution matching distillation"**.

- The **AMD EPYC 7C13 CPU** emerges as a cost-effective, high-performance option, offering 64 cores at a price point around $2000, positioning it closer to cloud rather than traditional enterprise pricing.

- **DBRX introduces a new standard for open Large Language Models (LLMs)** with a unique architecture featuring **16 experts** and a **top_k=4 routing** mechanism, as detailed by the project's pretraining lead.

- **Brandon's Digital Garden** introduces a tool designed to automatically add **actionable items from emails to a calendar**, addressing the common issue of overlooking medium-priority tasks that require future action.

- Adam Karvonen's research on **Chess-GPT** demonstrates that the model can learn a sophisticated understanding of chess, including board state and player skill, through next token prediction and self-supervised learning, as detailed in his [paper](https://arxiv.org/abs/2403.15498) and [blog post](https://adamkarvonen.github.io/machine_learning/2024/03/20/chess-gpt-interventions.html).

- Introducing the **Zero Mean Leaky ReLu** activation function, which offsets the traditional (Leaky)ReLu to address its non-zero-centered limitation, enhancing its behavior by incorporating the expectation of the output under a zero-mean normally distributed input.

- **Research scientists** in big tech companies often balance between **conducting research** and fulfilling **internal company responsibilities**, with the freedom to publish papers varying significantly.

- **CommodityAI** streamlines the **management of commodity shipments** by automating workflows and documentation processes, addressing the industry's challenge of handling around 200 processes and 50 documents per shipment.