Skip to content
Live
Research
Nov 5Thu
  1. The Decoder

    CloudOpsBench, a newly open-sourced benchmark, reveals AI's reasoning bottlenecks in cloud operations.

    CloudOpsBench version 1.0 includes 45 AWS cloud operations tasks developed by the University of Michigan team, discovering severe reasoning bottlenecks in AI agents. Claude Fable 5.1 solves only 60%, GPT-6 Astra 53%, with 80% failing due to misjudged task scope or incomplete checks, and 20% errors causing irreversible infrastructure damage. The project is open-sourced under the Apache 2.0 license.

  2. AWS Machine Learning Blog38

    How Indegene builds an LLM-driven data quality agent on AWS to achieve enterprise-grade data quality modernization and scalability

    Indegene built a production-grade LLM-driven data quality agent on AWS for its NEXT unified data platform (NEXT UDP), which generates context-aware data quality rules and verifies and generates executable SQL and Python code under centralized manual review governance, helping businesses improve data quality at scale and reduce the effort of building and maintaining data quality programs.

  3. The Decoder

    Anthropic releases FlashProve prototype, using cryptography to verify if AI responses come from the claimed model

    Anthropic has released the FlashProve prototype, using zkSNARK technology to verify the source of AI responses without exposing model weights. The system generates proofs for a 400B parameter Llama 4 Maverick on an H100 GPU at a speed of approximately 110 tokens/second, with proof sizes of about 19 MB, verification taking 17 seconds, but with 70x-95x overhead compared to normal inference.

    Same story · 5 outlets

    How the accounts differ:MarkTechPost states the proof volume is 18.78 MB; The Decoder states it is about 19 MB.

  4. The Decoder

    GPT-6 Astra reprograms other AI models directly through weights

    GPT-6 Astra reprograms other AI models directly by analyzing model weights, without traditional training. It correctly identifies the games and image generation shapes learned by the network, and by modifying 0.016% of the weights on Qwen3.5-0.8B, it increases the accuracy of the MATH-500 benchmark test from 7.9% to 48.1%. Researchers believe its potential lies in security audits and targeted behavioral adjustments, but the model's capabilities are still limited.

Nov 4Wed
  1. Together AI Blog50

    Together AI launches Polymorphic Inference: Adaptive open-source model inference technology

    Together AI Launches Polymorphic Inference Technology, Continuously Compiling and Optimizing Open Source Model Inference Performance Using AI Agents to Address Challenges Such as Model Release Acceleration, Architectural Diversity, and Rapid Changes in Workloads and Hardware Platforms. This Technology Enables Inference Systems to Adapt Quickly to Dynamic Environments, for Example, Achieving Near-Hardware-Limit Performance When 80% of OpenRouter Traffic Comes from Models Released in the Past Three Months.

  3. Hugging Face Daily Papers34

    LoCo: A local preference learning method for reasoning compression

    LoCo teaches reasoning models when to stop reasoning through local preference learning, significantly reducing output length in mathematical and code tasks while maintaining or improving accuracy. The method reduces completion length by 41.7%--45.4% on mathematical tasks and 23.4%--36.3% on code tasks, while maintaining or improving accuracy, and achieves the best AUC on all code benchmarks. LoCo's code and models will be publicly released.

  4. Hugging Face Daily Papers65

    FactEmbed: Enhancing Composed Image Retrieval Performance through Decomposed Embeddings

    FactEmbed decouples query understanding from embedding construction, simulating pre-retrieval visual modifications using decomposed latent vectors, significantly improving performance in composed image retrieval. The method outperforms existing technologies in the CIR benchmark, optimizing decomposed representations through intermediate target imagination, and achieving efficient inference using global-level embeddings and mean pooling of latent vectors.

  5. Hugging Face Daily Papers65

    EvoTeam: Achieving Multi-Agent Collaboration through Evolving Teams

    EvoTeam demonstrates effectiveness in four benchmark tests by executing experience-based joint evolution of team organization, interaction rules, and agent skills while maintaining a reusable team library. It maintains a reusable team library, guides collaboration through specific team interaction rules, and accumulates collaboration experience in compatible team contexts, with individual skills being reusable across different teams.

  6. Hugging Face Daily Papers65

    VidUEU-Agent: An intelligent agent for data management in multimodal understanding, editing, and unification tasks.

    The VidUEU-Agent framework solves the problem of scarce high-quality multimodal instruction data and high annotation costs in multimodal model development by automatically constructing instruction data from raw videos. The framework adopts a four-stage data construction process, combining visual language models and visual tools for evidence-based data synthesis, and utilizes downstream training feedback for autonomous iteration.

  8. ITHome · AI58

    Anthropic develops FlashProve open-source system: using cryptography to prove AI output source

    Anthropic is developing an open-source system called FlashProve, which uses cryptography to prove that AI output indeed comes from a specified model, similar to email encryption signatures. The system can prevent AI companies from secretly switching to different models, verify third-party statements about model usage, and does not disclose model weights, supporting closed-source models. The code has been open-sourced on GitHub. Current research is still ongoing and has not yet been deployed.

    Same story · 5 outlets

    How the accounts differ:MarkTechPost states the proof volume is 18.78 MB; The Decoder states it is about 19 MB.

  9. Ai2 Blog

    Ai2 collaborates with Google to launch a new generation climate model NeuralGCM+

    Ai2 receives a $10 million three-year grant from Google.org to collaborate with Google Research in developing the open-source climate model NeuralGCM+, aiming to improve the speed and reliability of climate predictions; the model extends from Google Research's NeuralGCM, combining physical equations with AI to simulate the joint effects of the atmosphere and oceans, with simulation cycles extended to decades, supporting regional rainfall and water resource change predictions, and plans to promote research community collaboration through open-source code and documentation.

  10. Hugging Face Daily Papers42

    Route Anything: A Research Framework for Model and Strategy Routing in General AI Systems

    The Route Anything framework enhances the performance and efficiency of general AI systems by dynamically selecting and coordinating different AI models and strategies. It has constructed a 250,000-run trajectory matrix covering 25 benchmark tests, including 452 configurations such as language understanding, image, video, speech generation, coding, task proxying, and robotic operation.

  12. Hugging Face Daily Papers65

    Pandora framework: Simulating personalized customer expressions in psychological therapy

    The Pandora framework generates more realistic and individualized customer expressions by modeling the evolution of psychological and relational states, reducing AI-like responses. In an evaluation of 115 cases, Pandora outperformed five baseline systems in expression similarity and disclosure consistency scores, with only 7.2% of 45 disclosures rated as AI-like expressions, significantly lower than the baseline systems' 43.3--67.2%.

  13. Hugging Face Daily Papers38

    YANAMI: A Large-Scale Multimodal Dataset and Benchmark for Multi-Round State Interaction

    YANAMI introduces a large-scale multimodal dialogue dataset and benchmark that requires models to track and implement evolving dialogue states across rounds, revealing that current unified multimodal models still struggle with this task. YANAMI-400K contains 400,000 multimodal dialogue rounds across 4 scenarios, requiring models to continuously track, store, and revise evolving multimodal dialogue states across rounds; YANAMI-Bench contains 400 multimodal rounds for system evaluation of multimodal state interaction, jointly evaluating dialogue state understanding and visual implementation.

  14. Hugging Face Daily Papers65

    MoviEdit: A framework for editing long-segment, multi-shot video

    MoviEdit framework, through cascaded bidirectional autoregressive modeling and new benchmark tests, maintains cross-scene coherence while reducing manual data annotation, significantly outperforming existing open-source models with performance comparable to industry leading models. The framework automatically generates 87K pairs of paired editing videos for cross-shot supervision, establishes a global editing draft using a lightweight bidirectional stage, and then performs autoregressive propagation and refinement.

  15. Hugging Face Daily Papers62

    Axion 1.0: An open-source foundation model for agents, simplifying implementation

    Axion 1.0 achieves competitive agent performance through a three-stage training process (two lightweight supervised fine-tuning + reinforcement learning) using fully open-source data and training pipelines. The model employs model-aware data construction and verifiable task generation, without specialized mid-training, direct preference optimization, or policy-intrinsic distillation, demonstrating excellent performance in multiple multi-agent benchmarks, comparable to leading commercial models in some tests, and openly sharing the complete development process to promote open-agent research.

  16. Hugging Face Daily Papers

    RoboColosseum evaluates physical intelligence in large-scale real environments

    RoboColosseum evaluates general robotic strategies across different robots and environments, finding weak consistency across robot platforms, limited open-world reliability, and significant differences in zero-shot and fine-tuning performance. This distributed evaluation framework assessed five visual language action (VLA) strategies and three cutting-edge AI agents on four robot platforms (SO-101, Franka, dual-arm YAM, humanoid G1). The results show that cutting-edge agents are comparable to dedicated VLA strategies, but all systems perform poorly in open-world tasks. RoboColosseum evaluates physical intelligence in large-scale real environments.

  17. Hacker News · AI hot posts65

    The revised edition of 'Generative AI Basics: A Visual Introduction to Mathematics' has been released.

    This book provides a concise derivation introduction, explaining the mathematical foundations of modern generative AI. It constructs a coherent understanding path by connecting the ideas of major generative model families (from PCA, variational autoencoders to diffusion models, GANs, etc.). The revised edition adds visual explanations, with 195 pages, suitable for researchers, practitioners, and students interested in mathematics.

  18. MarkTechPost71

    Anthropic open-sources FlashProve: using zkSNARK to prove responses from committed weights

    Anthropic's cutting-edge red team has released an open-source research prototype FlashProve, which uses zkSNARK to prove that a response is generated by committed model weights without revealing the weight information. On Llama 4 Maverick (400B MoE), a single H100 achieves a proof speed of approximately 110 tokens/s, with a proof size of 18.78 MB, and CPU verification takes 17 seconds.

    Same story · 5 outlets

    How the accounts differ:MarkTechPost states the proof volume is 18.78 MB; The Decoder states it is about 19 MB.

  20. TechCrunch · AI58

    Anthropic is developing a system called FlashProve to verify the identity of AI models

    Anthropic has released an open-source system called FlashProve, which uses cryptography to verify that specific outputs come from designated AI models, preventing model spoofing or replacement; the system requires AI labs to publish model fingerprints for verification without disclosing model weights, and the code is open-source.

    Same story · 5 outlets

    How the accounts differ:MarkTechPost states the proof volume is 18.78 MB; The Decoder states it is about 19 MB.

  21. Hugging Face Daily Papers65

    CrossSWE: Benchmark for testing large language models in cross-repository collaborative development

    CrossSWE benchmark tests the cross-repository consistency of large language models in cross-repository collaborative software development, including 171 instances, covering 165 repositories, 20 technical fields, and 13 programming languages. The evaluation shows that the strongest GPT-6.1 Sol only achieves 58.48% Pass@1, with cross-repository inconsistency being the main failure mode.

  23. Hugging Face Daily Papers65

    Order-Only On-Policy Distillation released

    Order-Only On-Policy Distillation (O^{3}PD) trains student models to match the token ordering of the teacher model rather than probabilities, averaging 2.9 points better than OPD on HMMT25, AIME24, and AIME25, with a 5.6 point improvement on AIME25. This technique requires no temperature tuning and is unaffected by the teacher model's temperature.

  27. ITHome · AI42

    NVIDIA claims AI is reshaping chip factories: simulation speeds up to 35 times, reducing engineer decision time from days to minutes.

    NVIDIA claims AI is driving semiconductor foundries into the 'AI-defined factory' phase, accelerating simulation technology to compress engineering simulation from hours and days to just minutes. Applied Materials' Ginestra platform's shape simulation accelerates up to 35 times, reducing engineer decision time from days to minutes.

  28. Meta Engineering34

    Meta launches F3 Lightning to accelerate the large-scale production of advertising ML features

    Meta launches F3 Lightning to address bottlenecks in F3 graph publishing by decoupling feature publishing from execution, enabling independent validation deployment. It adopts optimizations such as stable compute identifiers, a single execution plan, shared memory buffers, and dense index mapping, making the production speed of extraction features approximately 3.6 times faster than F3 without increasing infrastructure compute costs.

  30. Hugging Face Blog60

    IBM trains 20B small model Palette to generate slides according to its own design language

    IBM's research team fine-tunes a 20B open-source weight model, Palette, using a two-role LoRA scheme where designers write JSON briefs and encoders generate pptxgenjs code page by page to create presentations according to IBM Design Language.

    Why it matters: IBM uses synthetic data and checks to repair closed-loop training for a 20B small model to create presentations, providing a method that can be transferred to other structured outputs.

  31. Hugging Face Blog50

    StateBench: Testing how language models track state changes in long documents

    StateBench is a long-context state tracking benchmark that tests how language models maintain tracking changes in entity information within long documents. The benchmark includes four difficulty levels, ranging from simple immutable assignments to complex dependency assignments. It found that cyclic and hybrid models generalize better than Transformers on direct training tasks, but cutting-edge models like Gemini 3.8 Flash, Claude Opus 5.5, and GPT-6 Sol still fail in complex state tracking with long inputs.

  34. Hugging Face Blog62

    The same model with a different harness: Comparing CUGA, Hermes, and Deep Agents on AppWorld.

    The IBM team compared CUGA, Hermes, and Deep Agents using the same open-source weight model GLM-5.3-flash on 90 tasks in AppWorld, with pass rates of 81.1%, 46.7%, and 30.0%, respectively, and 20, 8, and 2 scenarios where all three variants passed.

    Why it matters: With the same model but a different harness, the task completion rate increased from 30% to 81%, and reproducible configurations and evaluation links were provided in the text.

Nov 3Tue
  1. Hugging Face Daily Papers65

    When Latent Prediction Error Supports Physical Anomaly Claims - Research on Video World Models

    Research shows that the latent prediction error in video world models reflects appearance and motion rather than reliable measurements of physical anomalies. Comparisons of latent prediction, masked pixel reconstruction, and simple visual statistics on the IntPhys2 benchmark show that appearance is easy to decode, and V-JEPA2 only slightly reveals whether an event is possible.

  2. Hacker News · 300+65

    Astra does not improve Qwen solely by reading weights, and the experimental design is misleading

    Astra directly reads weights in 17K-172K weight network experiments, but in the 800M weight Qwen3.5 mathematical ability improvement experiment, it requires combining Python programming and model execution, not just reading weights; Astra modifying 0.016% weights increased Qwen3.5-0.8B's MATH-500 from 7.9% to 48.1% and tripled IFEval.