# Nov 2, 2024

- **Nvidia's inclusion in the Dow Jones Industrial Average** marks a significant shift in the semiconductor landscape, reflecting its **170% stock surge** this year, while Intel's shares have plummeted over **50%**.

- **SPANN** introduces a **memory-disk hybrid indexing** system that efficiently combines in-memory algorithms with SSD storage, achieving **2× faster** performance than DiskANN while maintaining **90% recall quality** on billion-scale datasets.

- **TokenFormer** introduces a **natively scalable architecture** that enhances flexibility by treating model parameters as tokens, allowing for efficient scaling without retraining from scratch.

- **Project Zero's Big Sleep** has successfully identified a **previously unknown exploitable stack buffer underflow** in SQLite, showcasing the potential of large language models in real-world vulnerability detection.

- **SmolLM2** is a new family of compact language models from Hugging Face, featuring sizes of **135M, 360M, and 1.7B parameters**, designed for on-device performance across various tasks, trained on **11 trillion tokens** from diverse datasets including FineWeb-Edu and DCLM.

- **Torch.compile** has introduced significant **performance improvements**, raising questions about JAX's competitive edge in GPU acceleration, particularly in multi-GPU scenarios.

- **Ethernet technology is evolving rapidly**, with the IEEE's P802.3dj project aiming to standardize 200Gbps Ethernet lanes, paving the way for future capacities of 400GbE, 800GbE, and 1.6TbE, driven by advancements in silicon chip technology.

- **Neural networks inspired by physical interactions** utilize a weight matrix defined by a force-like inverse-square law, paralleling the **Coulomb matrix** in quantum chemistry, suggesting a novel approach to neural architecture design.

- **Prompts function as programs**, requiring a shift in how we perceive and construct them within AI Software systems (AISW), emphasizing their role in automation and reuse, akin to traditional software development practices.

- **RingGesture** introduces a **ring-based mid-air gesture typing system** that enhances text entry for lightweight AR glasses, utilizing electrodes and IMU sensors for precise hand tracking and intuitive cursor navigation.

- **Thinking LLMs** explores **instruction following** through a novel approach called "Thought Generation," aiming to enhance model performance in understanding and executing tasks.

- **Fine-tuning DINOv2's ViT-B 14** for semantic segmentation on the Cityscapes dataset revealed that an **ERFNet-based decoder** outperformed a **UperNet decoder** with scores of **76.06 mIoU** versus **74.22 mIoU**, challenging assumptions about multi-scale approaches.

- **Very Attentive Tacotron (VAT)** is a novel autoregressive Transformer-based TTS system that excels in **length generalization**, ensuring no dropped or repeated words across various utterance lengths, enhancing user experience in text-to-speech applications.

- **Zephyr** is a new **Functional Programming**-oriented framework built on **JAX**, designed to simplify the creation of neural networks by allowing users to define them as pure functions, enhancing readability and conciseness.

- The proposed **NCA simulation** leverages a **3D volumetric latent space** to enhance reasoning in language models, suggesting a shift from traditional language modeling to a more holistic **meaning model** that integrates physical mechanics and geometric representations.