May 11, 2024

• Roman snail dye, known as Tyrian purple, valued more than gold, has been discovered in the UK for the first time at a cricket club, marking a significant archaeological find.

• Google scientists have mapped a cubic millimetre of the human brain, uncovering cells with novel features and 150 million synapses, using a 1.4 petabyte dataset. Science article

• 'Ghost in the Shell' (1995) became a defining anime of the '90s, not by accident but through strategic international collaboration and marketing, aiming to capitalize on the growing Western interest in anime realism and cyberpunk themes.

• Artifacts in Vision Transformer (ViT) feature maps, identified in both supervised and self-supervised networks, manifest as high-norm tokens in low-informative background areas, impacting image processing quality.

• The 25th Anniversary Edition of "UNIX Viruses" celebrates the pioneering work of Silvio Cesare in ELF virus technology, marking a significant impact on computer security and the hacker community.

• Marimo redefines Python notebooks by emphasizing reproducibility, maintainability, and multipurpose use, aiming to transform notebooks from mere interactive tools into robust Python software, inspired by the author's experiences at Stanford and Google Brain.

• Discretization in Mamba involves transforming continuous data or models into a discrete form, but confusion arises as tokens in LLMs are already discrete.

• Marcus Hutter has authored two seminal books on Universal Artificial Intelligence (UAI), laying a foundation for combining sequential prediction with action to address challenges faced by intelligent agents in unknown environments.

• IBM's significant longevity contrasts with the average half-life of a publicly traded company, which is about a decade, regardless of the business sector, according to a study by the Santa Fe Institute.

• GraalVM enables writing and compiling C code within Java/Clojure environments, addressing Java's slow startup times and offering a new method for creating quick-starting serverless functions.

• Fine-tuning large language models (LLMs) with new factual information may inadvertently teach them to hallucinate incorrect responses, as they struggle to integrate this new knowledge with their pre-existing data.

• Biology-inspired joint distribution neurons, based on Hierarchical Correlation Reconstruction (HCR), enable multidirectional neural networks by modeling entire joint distributions, not just value dependencies.

• LoRA (Low-rank Adaptation) significantly reduces computational cost and time for finetuning large models on specific tasks by adjusting a small subset of the model's parameters.

• Platforms like Upwork often host ML engineers more experienced in integrating pre-built ML APIs than in developing custom models from scratch.

• Maicon Melo Alves, a High Performance Computing (HPC) system analyst specializing in AI workloads, has launched a book titled " Accelerate Model Training with PyTorch 2.X."