# Apr 28, 2024 ## Daily ### What can LLMs never do? - **LLMs struggle with tasks requiring iterative reasoning or memory of previous states**, such as playing Wordle or predicting cellular automata, despite excelling in other complex areas like chess or coding. ### AI-powered cameras installed on Metro buses to ticket illegally parked cars - **Los Angeles Metro buses** are being equipped with **AI-powered cameras** to identify and ticket vehicles illegally parked in bus lanes, aiming to enhance bus service efficiency. ### The Shitty Technology Adoption Curve - **The Shitty Technology Adoption Curve** illustrates how invasive technologies often begin with marginalized groups before becoming normalized across society, exemplified by the progression of surveillance from prisons to middle-class homes. ### Install Asdf: One Runtime Manager to Rule All Dev Environments - **`asdf` emerges as a versatile runtime manager** designed to simplify the management of development environments by allowing users to install and switch between multiple versions of programming languages seamlessly. ### LoRA+: Efficient Low Rank Adaptation of Large Models - **LoRA+** improves the **finetuning of large models** by addressing the suboptimal use of identical learning rates for adapter matrices **A and B**, a limitation found in the original LoRA method. ### [D] Real talk about RAG - **Skepticism arises** regarding the **practical utility** of **Retrieval-Augmented Generation (RAG)** models in **real-world applications**, as experiences with **managers and CXOs** suggest. ### Bloomberg: "Strong possibility" of M4 debuting on May 7 with new iPad Pro - The **upcoming iPad Pro** models are expected to feature the **next-generation M4 chip**, emphasizing an **upgraded Neural Engine** for enhanced AI performance, marking a significant leap from the M3 chip used in current MacBook Pro and iMac models. ### PySheets – Spreadsheet UI for Python - **PySheets revolutionizes data science** by offering a spreadsheet UI for Python, enabling users to import Excel sheets, analyze data with Pandas, and visualize results with Matplotlib, all within a browser. ### Let's Think Dot by Dot: Hidden Computation in Transformer Language Models - **Transformers can solve complex algorithmic tasks** by using **meaningless filler tokens** instead of detailed chain-of-thought responses, challenging the necessity of human-like task decomposition. ### Show HN: Cognita – open-source RAG framework for modular applications - **Cognita is an open-source framework designed to transition RAG (Retrieval-Augmented Generation) systems from prototyping in Jupyter notebooks to scalable, modular production environments**, utilizing Langchain/LlamaIndex for experimentation and offering a structured codebase with API-driven, extendable components. ### [D] Llama-3 based OpenBioLLM-70B & 8B: Outperforms GPT-4, Gemini, Meditron-70B, Med-PaLM-1 & Med-PaLM-2 in Medical-domain - **OpenBioLLM-Llama3-70B & 8B models** set a new benchmark in the **biomedical domain**, outperforming major models like **GPT-4, Gemini, and Med-PaLM series**, marking them as the most advanced open-source medical-domain LLMs currently available. ### Implementing Neural Networks on a "10-cent" RISC-V MCU - **Implementing neural networks on the CH32V003 RISC-V microcontroller**, which lacks a multiplication instruction, was achieved by optimizing neural network models for inference with quantized weights, demonstrating significant compression and efficiency. [Project details](https://github.com/cpldcpu/BitNetMCU) and [documentation](https://github.com/cpldcpu/BitNetMCU/blob/main/docs/documentation.md) provide comprehensive insights. ### Einsum for Tensor Manipulation - **Einsum offers a versatile approach for tensor manipulation in ML**, enabling operations like matrix multiplication and dot products with explicit documentation of tensor dimensions and implicit reordering. ### Using squeezed wav2vec2 to automatically detect owl calls - **Recent advances in machine learning** have made it possible to **detect animal calls from audio recordings in seconds**, challenging the notion that recognizing specific animal calls, like those of the Australian Powerful Owl, is impossible. ### Talking to memory: Inside the Intel 8088 processor's bus interface state machine - The **Intel 8088 processor**, introduced in 1979 and chosen for the IBM PC in 1981, communicates with memory and I/O devices through a **bus interface state machine** involving a **four-step bus cycle** complicated by **special cases and two undocumented steps** for efficiency.