Start using ChatGPT instantly
We’re making it easier for people to experience the benefits of AI without needing to sign up
Product
Uncategorised
Data Machina #247
New Open Mixture-of-Experts Models. Jamba SSM-MoE. Qwen1.5-MoE-A2.7B. DBRX 132B MoE. frankenMoEs. AI Agentic Workflows. 1-bit ML Models. OpenDevin. AgentStudio.
data-science, deep-learning, llm, Machine Learning
Tips for LLM Pretraining and Evaluating Reward Models
It’s another month in AI research, and it’s hard to pick favorites. This month, I am going over a paper that discusses strategies for the continued…
Product
Navigating the challenges and opportunities of synthetic voices
We’re sharing lessons from a small scale preview of Voice Engine, a model for creating custom voices.
deep-learning, Overviews, reinforcement-learning
Mamba Explained
Is Attention all you need? Mamba, a novel AI model based on State Space Models (SSMs), emerges as a formidable alternative to the widely used Transformer models, addressing their inefficiency in processing long sequences.
Global Affairs
OpenAI’s comment to the NTIA on open model weights
OpenAI’s comment to the NTIA on open model weights
This comment was submitted by OpenAI in response to NTIA’s March 2024 Request for Information on Dual-Use Foundation Models with Widely Available Weights.
Engineering, Research
Accelerating Vector Search up to +40% with Intel’s latest Xeon CPU – Emerald Rapids
Boosting Weaviate using SIMD-AVX512, Loop Unrolling and Compiler Optimizations
Product
Sora first impressions
Since we introduced Sora to the world last month, we’ve been working with artists to learn how Sora might aid in their creative process.