SCALE is a GPGPU programming toolkit designed to compile CUDA applications for AMD GPUs without requiring modifications to the original CUDA program or its build system, aiming to broaden CUDA's hardware compatibility.
General Theory of Neural Networks
Rob Leclerc proposes a unifying theory for Universal Activation Networks (UANs), which spans gene regulatory networks to artificial neural networks, emphasizing their shared properties of evolvability and open-endedness.
Guide to Machine Learning with Geometric, Topological, and Algebraic Structures
Modern machine learning is evolving to embrace non-Euclidean data, characterized by complex geometric, topological, and algebraic structures, diverging from the traditional Euclidean geometry foundation.
Human-like Episodic Memory for Infinite Context LLMs
EM-LLM introduces a novel approach that integrates human episodic memory aspects into large language models (LLMs), enabling them to handle infinite context lengths with high computational efficiency.
Transformer Layers as Painters
Empirical studies on frozen pretrained transformers reveal distinct behaviors between lower, middle, and final layers, with middle layers exhibiting uniformity.
Refuse Whenever You Feel Unsafe: Improving Safety in LLMs via Decoupled Refusal Training
The study introduces Decoupled Refusal Training (DeRTa), a novel method enhancing Large Language Models' (LLMs) safety by enabling them to refuse generating unsafe content across all response positions, addressing the refusal position bias in safety tuning data.
[R] What is Flash Attention? Explained
Flash Attention represents a major advancement over the traditional Attention mechanism by enhancing both space and time complexity.
[D] Detecting and Identifying Seen and Unseen Ads Using YOLO and Visual Transformers - Feasibility?
The project aims to detect both seen and previously unseen ads in images using a generalized YOLO model for initial detection and visual transformers for fine-grained identification.
MUSCLE: A Model Update Strategy for Compatible LLM Evolution
MUSCLE introduces a training strategy aimed at maintaining compatibility between Large Language Models (LLMs) updates, focusing on reducing user and downstream task model adaptation challenges.
[D] Best open source LLM for graph based questions answering
Open source Large Language Models (LLMs) are sought for two distinct tasks: creating knowledge graphs from unstructured text and answering questions based on these graphs.
[R] Any-Property-Conditional Molecule Generation with Self-Criticism using Spanning Trees
Spanning Tree-based Graph Generation (STGG) has been enhanced to STGG+, incorporating a Transformer architecture and random masking to generate molecules conditional on desired properties, significantly improving upon traditional SMILES and graph diffusion models.
[D] Ideas on how to improve time series forecasting with unknown data
Implementing ETS, SARIMAX, Holt-Winters, and N-beats with automatic hyperparameter tuning and an expanding window approach allows for adaptable time series forecasting across varied data types like monthly financial aggregations or daily sales data.
TwoMinutePapers - New AI: This Is A Gaming Revolution!
Embodied avatars in gaming now allow players to control their virtual characters with their own body movements, rather than traditional controllers, promising a more immersive experience.
Molecule Language Model with Augmented Pairs and Expertise Transfer
AMOLE, a novel molecule language model, addresses the scarcity of molecule-text paired data and the gap in expertise among researchers by introducing augmented pairs and expertise transfer mechanisms.
Stepwise Verification and Remediation of Student Reasoning Errors with Large Language Model Tutors
Large language models (LLMs) struggle to detect and tailor feedback to student errors in problem-solving, despite excelling in solving reasoning questions.