# Open Source AI Is the Path Forward

- **Meta releases Llama 3.1**, marking a significant step towards open source AI with models that are competitive in performance and cost efficiency, including the frontier-level 405B model.

- **Netflix has open-sourced Maestro**, a scalable workflow orchestrator designed for managing large-scale data pipelines and machine learning model training, now available on [GitHub](https://github.com/Netflix/maestro).

- **Llama 3.1 introduces models with up to 405 billion parameters**, featuring multilingual capabilities, a large context length of 128K tokens, and specialized safeguard models like Llama Guard 3 and Prompt Guard for detecting unsafe content and prompt injections.

- **Netflix's Maestro** is a **general-purpose workflow orchestrator** designed to manage data and ML workflows at scale, serving a diverse user base and handling millions of jobs daily with high scalability and extensibility.

- **A new method reconstructs dynamic scenes in 3D** from single monocular videos by leveraging **SE(3) motion bases** to model full-sequence-long 3D motion, addressing the challenge of monocular dynamic reconstruction.

- **Dom to Semantic Markdown** transforms HTML DOM into a **semantic, concise format** ideal for Large Language Models (LLMs), focusing on **maximizing semantic information** and **token efficiency**.

- **Llama 3.1 405B** launches, **comparable** to **GPT-4o** and **Claude 3.5 Sonnet** according to benchmarks, setting a new standard in language models.

- **Median filtering** operates by replacing each pixel with the median value from its neighborhood, effectively reducing noise without blurring edges, and can be generalized to percentile filtering for varied smoothing effects.

- **Neural networks**, when trained with the **Gradual Optimization Learning Framework (GOLF)**, **predict molecular geometries** with high accuracy using **50 times less data** than previously required.

- The **TTSDS benchmark** introduces a novel approach to evaluating **Text-to-Speech (TTS) systems** by focusing on factors like **prosody, intelligibility, and speaker identity**, using **Wasserstein distances** for scoring. [Read the paper](https://www.arxiv.org/abs/2407.12707)

- **Haipera** is an **open-source tool** designed to simplify hyperparameter sweeps in Python scripts and notebooks by eliminating the need for writing configuration and instrumentation code, leveraging static parsing for automation.

- **DataChain** is an open-source tool designed to **curate unstructured data** by reading from various sources, applying transformations through local models or external Large Language Models (LLMs), and storing the results efficiently.

- **FLUTE** extends **QLoRA** by incorporating **learnable scales** for **3-bit and 4-bit per parameter quantization**, significantly enhancing the efficiency of **LLM inference** by addressing the memory bandwidth bottleneck.

- **`scikit-activeml` version 0.5.0** introduces a comprehensive suite of **active learning strategies** and support for multiple learning paradigms, aiming to enhance data labeling efficiency by identifying the most informative samples.

- **WWDC 24 introduced Apple Intelligence**, showcasing **Mistral 7B**, a state-of-the-art language model running on Mac with less than 4GB memory, leveraging Core ML's new features for efficient, on-device AI.