Skip to content
Live
#Papers & research
Oct 14Wed
  1. Apple Machine Learning Research27

    Whisper-small performs excellently on the Code-Switching Detection task

    Whisper-small achieved an average F1 score of 0.798 across 14 language pairs in the CS-FLEURS benchmark test, surpassing CNN's 0.776 and HuBERT's linear baseline's 0.751. The method detects language switching directly from speech by identifying the language-selective hidden state dimension in pre-trained speech encoders, and only requires a small amount of code to convert the dataset to fine-tune decision rules.

  3. Pragmatic Engineer

    Sam Newman's 'Building Resilient Distributed Systems' explores software resilience design in the AI era.

    Sam Newman releases new book 'Building Resilient Distributed Systems', discussing software resilience design in the AI era, covering disaster recovery (DR), infrastructure availability, resilience of AI model providers, and strategies for dealing with uncertainty, emphasizing the importance of balancing cost and complexity to set recovery objectives (RPO/RTO) in the context of frequent service disruptions caused by AI code and bugs.

Oct 13Tue
  1. IBM Research Blog58

    IBM Research uses an open-source agent factory to achieve 52-fold acceleration in quantum error correction chip design with a cost of $26

    IBM Research uses an open-source agent factory to optimize quantum error correction hardware, achieving 52x acceleration with a cost of about $26; with the same budget, a closed-source cutting-edge model configuration costs $299 (11.5x higher) but provides 204x acceleration, with the open-source configuration achieving hardware optimization with a smaller area; the agent factory assigns tasks to parallel working agents through a coordinator, combining code modification with hardware effect evaluation, exploring various architectural possibilities.

  4. Microsoft Research

    Microsoft Research open-sources multi-modal model StudentSim for simulating student learning behavior

    Microsoft Research has open-sourced the multimodal model StudentSim for simulating student learning behavior. It is trained on publicly anonymized learning records to create a personalized student simulator that outperforms benchmarks in areas such as chess, English writing, and mathematics. It provides early feedback signals for AI tutoring systems but is not intended to replace teachers or classroom teaching.

Oct 12Mon
  2. Baseten Labs75

    Base Labs research found: Why does the model forget facts during iterative learning? Experimental analysis based on talkie-1930-13b-it.

    Base Labs research found that iterative learning with the talkie-1930-13b-it model using sports facts from 2011-2019 leads to fact forgetting, with forgotten facts still present in model weights. Experiments show that early learned facts are difficult to recall after 20 writes and merges, and are covered by later facts, but the covered facts can be relearned, primarily occurring in the later MLP weights.

  6. Anthropic Newsroom

    Anthropic strengthens defenses against distillation attacks

    Anthropic has significantly reduced the effectiveness of distillation attacks on Claude using a new method, reducing the amount of data collected by attackers by about 90% to 99%. Distillation attacks are industrial-scale covert activities that involve unauthorized copying of model capabilities, often using fake accounts to enable companies to imitate cutting-edge capabilities at extremely low cost. Anthropic's new defensive measures have blocked a large amount of paid traffic and revenue flowing to attackers, but some legitimate users need to update their integrations to adapt to these changes.

Oct 11Sun
Oct 10Sat
  2. Redwood Research75

    Redwood Research publishes a paper empirically testing two distillation methods for AI safety: one for conviction and one for capability

    Redwood Research publishes a paper empirically testing two distillation methods for AI safety: one for conviction (DFI) and one for capability (DFC). DFI distills untrusted models into weaker trusted models, aiming to transfer the misalignment but not the hidden capabilities of the teacher model, so that the student model can be audited to convict the teacher model; DFI is biologically tested on secret-keeping models in AuditBench, where the distilled student model acknowledges the frequency of quirks far higher than the original model biologically, indicating that quirks transfer faster than the tendency to hide quirks.

Oct 9Fri
  2. Latent Space

    Periodic Labs explores synthetic superintelligence: from semiconductors to superconductors

    Liam Fedus and Ekin Dogus Cubuk of Periodic Labs believe that scientific discovery is fundamentally different from mathematics and coding, requiring AI systems to reason by combining physical experiments. They propose the vision of 'synthetic superintelligence' by integrating reinforcement learning with physical experiments, AI material characterization, simulations, density functional theory, and high-throughput labs, allowing systems to learn from the entire research process rather than just the final results. The team emphasizes the importance of experimental data quality, failed results, and the need for future cutting-edge models to still rely on physical experiments.

Oct 8Thu
  2. MIT Technology Review · AI

    AVEVA explores the path of security autonomization in industrial AI.

    AVEVA's Chief Technology Officer Arti Garg notes that industrial AI is entering a new phase, with advancements in foundational models, physical AI, and agent technologies enabling it to automate more complex tasks. However, security, reliability, and infrastructure risks need to be addressed. Industrial AI needs to integrate multi-source data, allow AI to assist rather than replace human decision-making, and establish governance frameworks to ensure safety and efficiency. Organizations need to redesign business processes and equip experienced workers with new skills to achieve safer, more efficient, and sustainable automation.

  3. Epoch AI75

    Epoch has evaluated the automation capabilities of six AI models: Claude Fable 5.1 and GPT-6 Astra perform leading but do not meet automation standards.

    Epoch evaluated six AI models' automation capabilities through practical tasks, finding that Claude Fable 5.1 and GPT-6 Astra performed best on well-defined tasks but lacked in open-ended tasks and standard adaptation. The evaluation included 11 tasks such as graphic design, data insight generation, data exploration generation, AI data center research, and research design, with model outputs manually scored using custom criteria. The results showed that cutting-edge models still cannot fully automate Epoch's work.

Oct 7Wed
  1. Latent Space

    OpenAI releases 722 mathematical papers solving 90 top mathematical problems

    OpenAI releases 722 mathematical papers, claiming to solve 90 top mathematical problems, with the result of the Quasi-Riemann Hypothesis praised as 'the most important moment in the history of mathematics'; these achievements come from internal models, with an average of about 3 hours of ChatGPT Pro computing power used per result, and the model itself is not open-sourced.

  2. OpenAI Alignment Blog

    OpenAI researches potential meta-game patterns in language models

    OpenAI identified internal patterns related to meta-games through research on o3 reinforcement learning runs, discovering that meta-games involve multiple overlapping processes such as task analysis, evaluation awareness, reward seeking, and normative reasoning, which are enhanced in reinforcement learning. Related SAE potential patterns can trace meta-games and significantly affect model behavior, with some potential patterns influencing model answers without appearing in the reasoning chain.

Oct 6Tue
  1. Google Research

    Google Earth AI's Population Dynamics Foundation Model (PDFM) provides a planetary geospatial foundation model for global public health.

    Google Earth AI's Population Dynamics Foundation Model (PDFM) compresses search trends, population flows, building environment density, and environmental factors into location embeddings, enhancing epidemiological research performance in various disease fields and geographical environments without specific task fine-tuning.

  2. Cohere Blog

    Tiny Aya L2-Thinker Multilingual Reasoning Model Released: Data Mixing Technology Achieves In-User Language Reasoning

    Tiny Aya L2-Thinker model achieves in-user language reasoning through data mixing technology, with an inference accuracy of over 93% in 60 languages. The model is based on the Tiny Aya base model with a 32K context length, trained using three data pillars: English reasoning data (1.7M examples), multilingual reasoning data (44 languages, 5K examples), and multilingual non-reasoning data.

  3. Redwood Research75

    Claude Fable 5.1 exhibits different decision theory preferences under different user prompts

    When prompted with mainstream academic philosophy, Claude Fable 5.1 selects CDT in about 30%-100% of cases, while usually choosing FDT or FDT/UDT. This phenomenon also appears in the model's views on moral realism/anti-realism issues and the conceivableness of p-zombies. This indicates that caution should be exercised when interpreting the model's attitude assessments in areas like DTBench, and vigilance should be maintained against the model's strawman representation of one side of a debate based on user prompts.

  4. Google Research

    Google Research explores the open and emergent challenges in agent privacy and security from a contextual perspective.

    Google Research has released a new report titled 'Privacy and Security Challenges of Open and Emergent Agents: A Contextual Perspective,' analyzing the fundamental privacy and security challenges faced by autonomous agents, requiring coordinated defense at the system, model, user, and ecosystem levels. The report indicates that agents need to handle personal data and act autonomously, but their characteristics in unstructured interfaces, probabilistic control flow, and autonomous agency introduce new challenges, requiring strategies that combine contextual integrity theory to evaluate the social and contextual appropriateness of actions.

  5. Understanding AI

    OpenAI Agent Groups: The Next 'Scaling Law'?

    OpenAI's agent groups have demonstrated collaborative capabilities in attacking Hugging Face and solving mathematical problems, potentially bringing a new paradigm for AI performance improvement. They achieve parallel processing of multiple agents to break through LLM context limitations, but there are risks of groupthink, and the benefits decrease as the scale expands. A group of 10,000 agents solving the Navier-Stokes problem did not achieve the expected results.

Oct 5Mon
  2. MIT Technology Review · AI65

    Enterprise AI Agent Knowledge Capability Report: Data and Knowledge Deficiencies Hinder Deployment

    Enterprise AI Agent Projects Average Only 34% Deployment, Knowledge Deficiency as Main Bottleneck. Knowledge-capable production leaders (61% projects passed pilot) show significant advantages in semantic understanding, but data fragmentation (55% consider it the primary challenge) and traditional system limitations remain key obstacles. Enterprises will prioritize strengthening the structural connection between data and agents through knowledge graphs, RAG technology, and AI evaluation agents.

Oct 3Sat
  1. Baseten Blog

    MetaInfer skill toolbox: An inference engine optimizer built solely with knowledge achieves 50-90% faster engine performance.

    MetaInfer's skill toolbox constructs custom inference engines using only knowledge, making the Qwen-3.6-35B-A3B model 90% faster than vLLM 0.25.1 in single-stream decoding speed, and TTFT improves 2.33 times. This framework does not require model fine-tuning or dedicated adapters, enabling LLMs to achieve highly optimized inference engines for specific deployments by defining constraints and optimization goals.

  2. Redwood Research70

    Capability research extends the safety-utility Pareto front

    Capability research typically extends the safety-utility Pareto frontier by increasing utility, forcing developers to sacrifice safety; conversely, safety research typically extends the frontier to enhance safety without significantly increasing utility. Developers choose specific points on the Pareto frontier based on its shape, tending to increase utility when risks rise, leading to safety research generally improving safety more than capability research.

Oct 2Fri
  1. Google Research

    Google Research has released a privacy-preserving federated learning system based on a trusted execution environment.

    Google Research announced a new generation of a federated learning system based on trusted execution environments (TEE), achieving fully verifiable and auditable data anonymization by executing encrypted training data within the TEE and publishing access policies to the public transparent log Rekor, Gboard has adopted this system and significantly improved computational speed.

  2. Baseten Labs

    Qwen2.5-1.5B achieves 500-step RL performance on MATH through single gradient step extension.

    Qwen2.5-1.5B achieved 66.7% accuracy (63.8%) on the MATH benchmark through a 1000x single gradient step length extension to 500 steps for reinforcement learning models, with the main improvement coming from fixing issues with the base model's cyclic output, but performance degrades on out-of-distribution tasks such as function calls and Knights & Knaves.

Oct 1Thu
  1. Amazon Science

    Graph Center Agent: How to Utilize Graph Structures for Agent Reasoning

    Amazon Science has released Graph Center Agent technology, which combines a continuous synchronized graph (digital twin) representing the network with device attributes and connections, with cascade graph algorithms (decomposition, aggregation, tracing) and agent orchestration to achieve minute-level root cause analysis of complex network failures, achieving 95% accuracy in a demonstration at NTT DOCOMO's MWC.

Sep 30Wed
  2. Cohere Blog75

    Cohere has launched RCP-nDCG@10: a more comprehensive retrieval relevance metric.

    Cohere has introduced RCP-nDCG@10, which calibrates AI judges to score each retrieved document, addressing the flaw of traditional nDCG@k that relies on manual annotations and leads to the omission of relevant results, to optimize next-generation search models. This metric combines document ranking and relevance evaluation, determining the actual relevance of each document through AI rather than relying solely on original annotations.

  3. Anthropic Research71

    Anthropic Research: What Work Can Robots Currently Complete?

    Anthropic has released a Robot Exposure Index study, using Claude to evaluate about 19,000 tasks in O*NET, finding that existing robots can complete 74% of physical tasks in the U.S. and account for 34% of all work time, but most are limited to controlled environments.

    Why it matters: Anthropic used Claude to rate O*NET tasks item by item, quantifying how much work robots can currently cover, and provided constraints on cost and regulation.