Skip to content
Live
Research#Engineering
  1. QbitAI72

    Baidu Wenxin has first disclosed the progress of RSI, and ERNIE Evolve has been used in the development of Wenxin 5.5 Flash.

    Baidu Wenxin first disclosed its automatic research system ERNIE Evolve, which can autonomously propose research directions, conduct experiments, and validate results. It has been used for inference optimization in Wenxin 5.5 Flash. In the low-latency scenario optimization for Kunlun Chip P800, ERNIE Evolve took about 168 hours and went through 4 rounds of direction exploration, with the optimal version's generation speed increasing to 623.6% of the baseline. The deterministic reasoning throughput optimization increased the throughput to 133.7% of the baseline in 3 days.

    Why it matters: Baidu has disclosed the architecture and production environment optimization data of the automatic research system ERNIE Evolve, which can observe the actual landing points of RSI in inference optimization.

  1. vLLM Blog72

    REINFORCE Zero: Aligned kernel allows asynchronous RL to train stably under lag 64.

    NVIDIA Research and Inferact's REINFORCE Zero proposes to first align rollout with training kernel, then use unclipped token-level importance sampling to correct weight lag, achieving a training step throughput 2.40 times that of synchronous training under 16 GPUs and 12K updates.

    Why it matters: The paper breaks down the gap between asynchronous RL's rollout and training into two items: weight lag and kernel inconsistency, and proposes an alignment-free, no-trimming importance sampling method after alignment.

  1. MarkTechPost71

    Microsoft and UC Berkeley release TokenEconomizer plugin, coding agent costs reduced by up to 30.9%

    Microsoft Research and UC Berkeley's research team released the open-source cost controller TokenEconomizer, which can reduce the cost of encoding agents without changing model weights and agent code.

    Why it matters: The original text provides the cost reduction of the plugin on 277 SWE-Bench tasks and the change in Pass@1, which can be used to judge its impact on the coding agent workflow.

  1. Meta Engineering66

    Meta rolls out JiTTesting to production: Use LLM to generate tests and catch bugs before code merge

    Meta announced that Catching JiTTests has been put into internal production, using LLM to automatically generate executable tests for diffs to be merged, exposing behavioral differences before the code is landed

    Why it matters: Meta has disclosed the production deployment details and quantitative results of JiTTests, available for evaluating the implementation of LLM-generated tests in ultra-large-scale codebases.

You are all caught up