Meet LeVLJEPA: the first fully non-contrastive end-to-end vision-language pretraining method competitive with CLIP and SigLIP
No negatives. No temperature. No momentum encoder. No teacher-student.
LeVLJEPA learns image to text structure by prediction: each modality predicts the other's embedding, while SIGReg keeps each embedding isotropic Gaussian.
Code
Model
No negatives. No temperature. No momentum encoder. No teacher-student.
LeVLJEPA learns image to text structure by prediction: each modality predicts the other's embedding, while SIGReg keeps each embedding isotropic Gaussian.
Code
Model
arXiv.org
LeVLJEPA: End-to-End Vision-Language Pretraining Without Negatives
Vision-language pretraining remains dominated by contrastive objectives, whereas vision-only self-supervised learning has largely adopted non-contrastive methods. At the same time, the role of...
❤4🔥2🥰2👏2
Bytedance introduced EdgeBench, a benchmark designed to study how agents learn from environments over at least 12~72-hour runs.
EdgeBench is built with three ingredients:
1. Real & Diverse: 134 real-world tasks across 6 task categories, spanning scientific problems, professional knowledge work, software engineering, optimization, formal math, and games.
2. Ultra-Long-Horizon: Each task supports 12–72 hours of agent work. Recorded human effort averages 57.2 hours.
3. Informative Feedback: Agents receive real-world feedback for continuous improvement.
After 38,000 hours of agent runs on EdgeBench, a scaling law for learning from environments emerges:
- As agents interact with task environments over time, their aggregate performance is precisely fit by a log-sigmoid function.
- This phenomenon can be explained by an elegant theory of graph exploration.
EdgeBench is built with three ingredients:
1. Real & Diverse: 134 real-world tasks across 6 task categories, spanning scientific problems, professional knowledge work, software engineering, optimization, formal math, and games.
2. Ultra-Long-Horizon: Each task supports 12–72 hours of agent work. Recorded human effort averages 57.2 hours.
3. Informative Feedback: Agents receive real-world feedback for continuous improvement.
After 38,000 hours of agent runs on EdgeBench, a scaling law for learning from environments emerges:
- As agents interact with task environments over time, their aggregate performance is precisely fit by a log-sigmoid function.
- This phenomenon can be explained by an elegant theory of graph exploration.
EdgeBench
EdgeBench | Scaling Laws of Environment Learning
EdgeBench studies how agents learn from real-world environments across 134 day-long executable tasks.
🆒4❤2🔥1🤔1
Google introduced Paper Assistant Tool (PAT)
It's an AI framework built to review full scientific manuscripts, check theoretical results, validate experiments, and flag flaws.
PAT uses inference scaling to dig deeper than a single model call, achieving a 34% improvement in recall on mathematical errors (SPOT benchmark).
Already piloted at STOC and ICML, it catches critical errors early, easing referees' burden while keeping human oversight.
It's an AI framework built to review full scientific manuscripts, check theoretical results, validate experiments, and flag flaws.
PAT uses inference scaling to dig deeper than a single model call, achieving a 34% improvement in recall on mathematical errors (SPOT benchmark).
Already piloted at STOC and ICML, it catches critical errors early, easing referees' burden while keeping human oversight.
arXiv.org
Towards Automating Scientific Review with Google's Paper Assistant Tool
Artificial intelligence is driving a revolution in scientific discovery, accelerating everything from hypothesis generation to mathematical theorem proving. However, this rapid acceleration is...
🔥5🥰3👏3
Meituan introduced LongCat-2.0 a fully open-source MIT licensed, no restrictions.
The model weights and inference code to everyone.
1. 1.6T MoE · ~ 48B active · 1M token context
2. Agent-native: Integrates directly with Claude Code, OpenClaw, and Hermes Agent
3. Deployment: Support both GPU and NPU platforms verified on large-scale domestic clusters
The model weights and inference code to everyone.
1. 1.6T MoE · ~ 48B active · 1M token context
2. Agent-native: Integrates directly with Claude Code, OpenClaw, and Hermes Agent
3. Deployment: Support both GPU and NPU platforms verified on large-scale domestic clusters
longcat.ai
Introducing LongCat-2.0
1.6万亿总参大模型,训练全程由国产芯片完成
❤7🔥3🥰2
Tencent just dropped Hy3
- 295B total params, 21B active. Compare to DeepSeek/Qwen at ~1T, overseas frontier at ~10T.
- API: ¥1 / ¥4 / ¥0.25 per M tokens. Cheapest Chinese model on the market. Cheaper than DeepSeek. ~7× cheaper than GLM-5.2.
- Token efficiency vs GLM-5.2 on office tasks: docs -47%, PPT -49%.
- Hallucination rate 12.5% → 5.4%. MRCR long-context 42.9% → 75.1%.
- SWE-Bench variance across 3 scaffolds (Codebuddy/Cline/KiloCode) ≤4 pp.
- 270-expert blind eval: Hy3 2.67/4 vs GLM5.1 2.51/4.
FREE API for 2 weeks
"Striking distance of frontier" is the wrong frame. At 21B active params, Hy3 isn't trying to be frontier. It's showing the frontier isn't where the value is.
The actual thesis buried in the announcement: scaling is moving from pretraining to RL + product feedback loops. WorkBuddy (Tencent's white-collar agent, #1 in workflow by user base) is the data flywheel. Pretraining scale plateaued. The new bottleneck is real-world task environments.
If that's right, the small-model-cheap-API play isn't a price war. It's the new architecture
- 295B total params, 21B active. Compare to DeepSeek/Qwen at ~1T, overseas frontier at ~10T.
- API: ¥1 / ¥4 / ¥0.25 per M tokens. Cheapest Chinese model on the market. Cheaper than DeepSeek. ~7× cheaper than GLM-5.2.
- Token efficiency vs GLM-5.2 on office tasks: docs -47%, PPT -49%.
- Hallucination rate 12.5% → 5.4%. MRCR long-context 42.9% → 75.1%.
- SWE-Bench variance across 3 scaffolds (Codebuddy/Cline/KiloCode) ≤4 pp.
- 270-expert blind eval: Hy3 2.67/4 vs GLM5.1 2.51/4.
FREE API for 2 weeks
"Striking distance of frontier" is the wrong frame. At 21B active params, Hy3 isn't trying to be frontier. It's showing the frontier isn't where the value is.
The actual thesis buried in the announcement: scaling is moving from pretraining to RL + product feedback loops. WorkBuddy (Tencent's white-collar agent, #1 in workflow by user base) is the data flywheel. Pretraining scale plateaued. The new bottleneck is real-world task environments.
If that's right, the small-model-cheap-API play isn't a price war. It's the new architecture
openrouter.ai
Hy3 - API Pricing & Benchmarks
Hy3 is a 295B-parameter Mixture-of-Experts model from Tencent (21B active, 192 experts with top-8 routing) built for reasoning, agentic workflows, and real-world production use. $0.1288 per million input tokens, $0.5336 per million output tokens. 262,144…
🆒4❤3🔥2👍1😁1
DoorDash released DashBench, an internal benchmark to compare multi-model/harness code review systems against each other.
DashBench has given confidence in maximizing the intelligence per dollar they’re spending on AI tokens to ship code safely.
DashBench has given confidence in maximizing the intelligence per dollar they’re spending on AI tokens to ship code safely.
DoorDash
How we learned to trust our AI code reviewer at DoorDash - DoorDash
How DoorDash learned where to trust its AI code reviewer, triangulating human, production, and agentic signals across real PRs instead of one metric.
🔥2🥰2👏2
Anthropic extended access to Claude Fable 5 on all paid plans through July 12.
Claude
Claude Fable 5 on your plan | Claude Help Center
❤3🔥2🥰2
Rightnow AI introduced The AGI compiler
it watches your LLM agent work, finds the parts that are secretly deterministic, and compiles them into verified binaries that cost nothing to run
LLMs are just the first frontend, world models and new model types plug into the same toolchain, that's why it's a compiler.
AGI compiler means one narrow testable thing, a system that turns novel experience into permanent verified near free skill while measuring what it does not know.
Researchers did not build agi, they built the loop anything deserving the name must contain.
36,843 lines of rust, all open.
GitHub.
same 300 tasks, same verified answers, 6.4x less money
it watches your LLM agent work, finds the parts that are secretly deterministic, and compiles them into verified binaries that cost nothing to run
LLMs are just the first frontend, world models and new model types plug into the same toolchain, that's why it's a compiler.
AGI compiler means one narrow testable thing, a system that turns novel experience into permanent verified near free skill while measuring what it does not know.
Researchers did not build agi, they built the loop anything deserving the name must contain.
36,843 lines of rust, all open.
GitHub.
same 300 tasks, same verified answers, 6.4x less money
❤3🔥2👏2👍1
Meet DeepTutor v1.5: Agent-native Personalized Tutoring.
DeepTutor connects teaching, practice, behavioral traces, unified Runtime, inspectable memory, and proactive IM companions into one evolving learner model.
It is an agent-native learning workspace that connects tutoring, problem solving, quiz generation, research, visualization, and mastery practice in one extensible system.
DeepTutor connects teaching, practice, behavioral traces, unified Runtime, inspectable memory, and proactive IM companions into one evolving learner model.
It is an agent-native learning workspace that connects tutoring, problem solving, quiz generation, research, visualization, and mastery practice in one extensible system.
deeptutor.info
DeepTutor — Agent-native, open-source personalized tutoring
An open-source, agent-native learning companion: Chat, Partners, Co-Writer, Book, Knowledge, Space, Memory, and Settings in one local workspace.
❤3🔥2👏2
New research from Anthropic. Some AI capabilities are both helpful and dangerous.
E.g., knowledge of virology can be used to create life-saving vaccines or deadly pathogens.
Anthropic introduced GRAM, a training method that puts dual-use capabilities (like virology) into removable modules.
Researchers tested models from 50M to 5B parameters. Knowledge separation gets better with scale: larger models forget the removed subjects more thoroughly and resist retraining better.
Real training data isn't neatly labeled. So team tested what happens when half of it has no topic labels at all. Versus alternatives, GRAM better separates dangerous knowledge from the rest of the model.
Paper.
Code.
E.g., knowledge of virology can be used to create life-saving vaccines or deadly pathogens.
Anthropic introduced GRAM, a training method that puts dual-use capabilities (like virology) into removable modules.
Researchers tested models from 50M to 5B parameters. Knowledge separation gets better with scale: larger models forget the removed subjects more thoroughly and resist retraining better.
Real training data isn't neatly labeled. So team tested what happens when half of it has no topic labels at all. Versus alternatives, GRAM better separates dangerous knowledge from the rest of the model.
Paper.
Code.
Anthropic
An off switch for dual-use knowledge in AI models
New results on a method of controlling access to potentially dangerous AI capabilities
🔥2🥰2👏2
Meta just now introduced Muse spark 1.1 is an industry-competitive agentic and coding model.
It's available through a new Meta Model API and in Meta AI.
It's available through a new Meta Model API and in Meta AI.
Meet The Agentic Garden of Forking Paths
Give two AI agents the same data, the same question, and the same instruction to "analyze it rigorously"; change only one paragraph's persona stating a prior belief, and they reach opposing scientific conclusions.
Code.
Give two AI agents the same data, the same question, and the same instruction to "analyze it rigorously"; change only one paragraph's persona stating a prior belief, and they reach opposing scientific conclusions.
Code.
❤3🆒3🔥2👏1
Check out TRACE, a new self-improvement approach where the agent identifies the missing capabilities behind its own failures and trains itself to address them.
TRACE-trained Qwen3.6-27B reaches 73.2% on SWE-bench Verified, outperforming much larger models like Codex 5.2 and GLM 5, while beating GRPO and GEPA with <1/4 the training rollouts.
By contrasting successful and failed trajectories, TRACE identifies its own weaknesses (such as bug localization or retrieval of the correct doc) and creates new synthetic environments to fix them.
The result is a transferable and sample-efficient synthetic env / data generation + fine-tuning pipeline for agentic tasks.
TRACE-trained Qwen3.6-27B reaches 73.2% on SWE-bench Verified, outperforming much larger models like Codex 5.2 and GLM 5, while beating GRPO and GEPA with <1/4 the training rollouts.
By contrasting successful and failed trajectories, TRACE identifies its own weaknesses (such as bug localization or retrieval of the correct doc) and creates new synthetic environments to fix them.
The result is a transferable and sample-efficient synthetic env / data generation + fine-tuning pipeline for agentic tasks.
hgkang02.github.io
TRACE: Capability-Targeted Agentic Training
Turning recurrent agent failures into capability-targeted training environments.
🔥2🥰2👏2
Stablecoin firm Circle wins final OCC approval to open national trust bank
Circle shares rose more than 7.7% in pre-market trading after the company said it received final approval from the U.S. Office of the Comptroller of the Currency (OCC) to establish First National Digital Currency Bank, N.A., which will operate as Circle National Trust.
Once launched, the bank will initially provide fiduciary digital asset custody services to Circle and its affiliates
Circle shares rose more than 7.7% in pre-market trading after the company said it received final approval from the U.S. Office of the Comptroller of the Currency (OCC) to establish First National Digital Currency Bank, N.A., which will operate as Circle National Trust.
Once launched, the bank will initially provide fiduciary digital asset custody services to Circle and its affiliates
Circle
Circle Gets OCC Approval to Establish National Trust Bank | Circle
Circle National Trust aligns digital asset infrastructure with the longstanding role of national trust banks in safeguarding client assets under strict fiduciary standards.
❤3🔥2👏2
Wowww! Yann LeCun is raising a new AI-focused VC fund.
He raised $1bn earlier this year for his startup Ami.
Now he's raising a fund.
The firm, named Extelligence Invest, will invest in companies across:
1. AI and data infrastructure
2. Healthcare technologies and human longevity
3. Cross-border consumer platforms
4. Frontier deeptech, including robotics, new mobility and compute.
He raised $1bn earlier this year for his startup Ami.
Now he's raising a fund.
The firm, named Extelligence Invest, will invest in companies across:
1. AI and data infrastructure
2. Healthcare technologies and human longevity
3. Cross-border consumer platforms
4. Frontier deeptech, including robotics, new mobility and compute.
Sifted
Exclusive: Yann LeCun’s newly-launched fund shuts as exclusivity relationships emerge
Extelligence Invest, a newly-launched VC firm which counted ‘AI godfather’ Yann LeCun as a general partner, has shut down.
🦄4❤3🔥2👏2
Meet MIRA a playable, multiplayer world model.
Trained on 10k hours of data collected with publicly available bots, MIRA learns the dynamics of a four-player game. The model runs in real time at 20 fps, based on the keys you and the other players press.
Play the demo, read the technical report, and explore the open-source code
Built by General Intuition and Kyutai, in collaboration with Epic Games. Not used to develop Rocket League.
Trained on 10k hours of data collected with publicly available bots, MIRA learns the dynamics of a four-player game. The model runs in real time at 20 fps, based on the keys you and the other players press.
Play the demo, read the technical report, and explore the open-source code
Built by General Intuition and Kyutai, in collaboration with Epic Games. Not used to develop Rocket League.
❤3🔥2🥰2
Meet Soofi S an open foundation model for German and English
Trained end-to-end on Deutsche Telekom’s Industrial AI Cloud in Munich.
Soofi S 30B-A3B a Mixture-of-Experts hybrid Mamba model trained on ~27 trillion tokens with deliberately up-weighted German.
Trained end-to-end on Deutsche Telekom’s Industrial AI Cloud in Munich.
Soofi S 30B-A3B a Mixture-of-Experts hybrid Mamba model trained on ~27 trillion tokens with deliberately up-weighted German.
huggingface.co
Soofi S — Sovereign German-English Foundation Model - a Hugging Face Space by Soofi-Project
Soofi S 30B-A3B pretraining report project page
🔥3🥰3👏2
Google published the Gemma 4 Technical Report
Read how researchers achieved memory and inference across the family.
How a 5:1 local-to-global attention ratio combined with pp-RoPE reduced the KV cache footprint.
Or how speculative decoding and Multi-Token Prediction drafters work.
Read how researchers achieved memory and inference across the family.
How a 5:1 local-to-global attention ratio combined with pp-RoPE reduced the KV cache footprint.
Or how speculative decoding and Multi-Token Prediction drafters work.
arXiv.org
Gemma 4 Technical Report
We introduce Gemma 4, a new generation of open-weight, natively multimodal language models in the Gemma model family. Designed to advance compute efficiency and reasoning, the Gemma 4 model suite...
🔥3🥰3👏2
16 Nobel Laureates, over 200 top economists, and top AI researchers signed "We Must Act Now: A Statement on AI’s Transformation of the Economy."
A Statement on AI’s Transformation of the Economy:
1. AI may become radically more powerful over the next 10 years.
2. This could drive an unprecedented transformation of our economy, larger than the Industrial Revolution, but unfolding over a vastly shorter time frame. It could bring risks, including large-scale job displacement, as well as opportunities such as major gains in living standards.
3. Economists, policymakers and technology leaders must act now to understand the economics of transformative AI and to build the incentives, guardrails, and institutions needed to steer AI in a direction that complements humans and benefits society.
A Statement on AI’s Transformation of the Economy:
1. AI may become radically more powerful over the next 10 years.
2. This could drive an unprecedented transformation of our economy, larger than the Industrial Revolution, but unfolding over a vastly shorter time frame. It could bring risks, including large-scale job displacement, as well as opportunities such as major gains in living standards.
3. Economists, policymakers and technology leaders must act now to understand the economics of transformative AI and to build the incentives, guardrails, and institutions needed to steer AI in a direction that complements humans and benefits society.
Skyfall AI presented Morpheus, a persistent enterprise simulation platform designed to make Continual Learning a reality.
Morpheus is the world’s first real world Reinforcement Learning environment.
Every Reinforcement Learning environment operates in the game world.
Benchmarks like Atari, OpenAI Gym, MuJoCo, and Procgen are all small, game-like worlds that reset every few minutes.
Skyfall tested how frontier LLMs would perform in realistic and dynamic business environments on Morpheus. The main conclusion was that LLMs are not continual learners.
HuggingFace.
Morpheus is the world’s first real world Reinforcement Learning environment.
Every Reinforcement Learning environment operates in the game world.
Benchmarks like Atari, OpenAI Gym, MuJoCo, and Procgen are all small, game-like worlds that reset every few minutes.
Skyfall tested how frontier LLMs would perform in realistic and dynamic business environments on Morpheus. The main conclusion was that LLMs are not continual learners.
HuggingFace.
skyfall.ai
Skyfall AI
Building Enterprise Super Intelligence
❤4🔥3🥰2