Skip to content
Live
Nov 4Wed
  1. QbitAI58

    How does openJiuwen Agent-Memory achieve audio-visual dual-stream memory, understand long videos?

    openJiuwen Agent-Memory 0.2.0 version launched multimodal memory capabilities OmniMem-Lens, which understands video events through visual and auditory dual streams, recall accuracy improved by up to 45.7%, and online Q&A latency reduced by up to 97%. This technology segments memory according to real events, establishing a three-layer memory structure to achieve offline construction and online query, demonstrating outstanding performance on the EgoLife-QA benchmark set, with longer videos showing more significant latency reduction.

  2. ITHome · AI65

    YouTube's promoted AI music composition tool 'Replace Songs' helps creators resolve audio copyright disputes

    YouTube's promoted AI music composition tool 'Replace Songs' allows creators to instantly generate four royalty-free instrumental background music tracks to replace copyrighted audio upon receiving an audio copyright claim, and automatically removes the relevant Content ID copyright notice. This feature currently only generates instrumental background music and does not support vocal or full song creation.

Nov 3Tue
  1. Hugging Face Daily Papers65

    When Latent Prediction Error Supports Physical Anomaly Claims - Research on Video World Models

    Research shows that the latent prediction error in video world models reflects appearance and motion rather than reliable measurements of physical anomalies. Comparisons of latent prediction, masked pixel reconstruction, and simple visual statistics on the IntPhys2 benchmark show that appearance is easy to decode, and V-JEPA2 only slightly reveals whether an event is possible.

  2. Hugging Face Daily Papers

    Reviso: Not All Visual Evidence Should Be Given Equal Attention in Video Caption Generation

    Reviso is an intelligent video subtitle framework that prioritizes key visual evidence through hierarchical planning and active perception learning, enhancing subtitle quality and downstream video understanding capabilities. Multimodal large language models (MLLMs) generated video subtitles may overemphasize minor details while ignoring important context and key events.

  3. Hugging Face Daily Papers

    How Agent Harness Achieves Video Generation and Agent Interaction

    Agent Harness Integrates Video Generation and World Model, Supporting Agents in Multi-Camera Video Production for Planning, Tool Use, and Recursive Self-Improvement. The Framework Coordinates Script, Shooting Planning, Asset Management, Production, and Editing, and Analyzes Its Evaluation Challenges; Meanwhile, It Studies Agent-World Model Interaction in Observation, Control, Execution, and State Maintenance, as Well as How They Mutually Evaluate and Improve.

  4. Hugging Face Daily Papers34

    Venus-DefakerOne2: A broader visual forensics base model

    Venus-DefakerOne2 extends detection to multiple spoofing forms and media types through alternating LoRA and full-parameter fine-tuning, as well as entropy-based test adaptive, achieving SOTA performance in six benchmark tests including DeepFake faces (96.7%), AI-generated images (93.3%), and tampered documents (87.6%), significantly outperforming expert models and predecessor DefakerOne.

Nov 1Sun
  1. The Decoder42

    Google DeepMind released StreamVibe video agent to understand user needs

    Google DeepMind released StreamVibe video agent, a model based on Qwen3.5-9B and specifically trained to understand ambiguous requests and provide help when appropriate, improving response timing and quality by 10.7% on ProactiveBench and increasing proactive interaction rate by 12.3%. Tests show it outperforms other open-source models, but it still struggles to track changes in long videos (>5 minutes), with performance dropping to 38.5% of the benchmark.

Oct 31Sat
Oct 30Fri
  1. Hugging Face Daily Papers52

    WeVisCut: An integrated smart editing agent from narration to long videos

    WeVisCut coordinates video editing tools, recovers from failures, and reduces token usage through a compact strategy trained on 9B parameters, while maintaining output quality. The system employs a four-stage data pipeline, combining editing inversion and validation replay, to generate over 130K training examples from 3,750 finished videos for training a single strategy.

  2. Codex releases45

    Codex 0.166.0 released: adding keyboard driver transcription selection, Markdown rendering optimization, and GPT-6.1 Terra support

    Codex 0.166.0 released, adding keyboard driver transcription selection (supporting word, line, and page operations), integrated search and configurable shortcuts, as well as consistent Markdown rendering in asynchronous questions, options, answers, and transcription responses. Also supports GPT-6.1 Terra and adds codex queue --resume feature to resume unloaded threads.

Oct 29Thu
  1. QbitAI72

    Genspark releases Media Studio video Agent workbench

    Genspark releases video Agent workbench Media Studio, integrating over 70 model versions from more than 20 manufacturers, where large language models act as directors responsible for writing scripts and scheduling video, image, and audio models.

    Why it matters: The author conducted a complete test of the entire process from short drama to knowledge explanation video, allowing readers to judge the completeness and shortcomings of multi-model arrangement in real-world creation based on this.

Oct 28Wed
  1. Hugging Face Daily Papers65

    CodeCap-Bench: Can executable code serve as high-quality video subtitles?

    CodeCap-Bench demonstrates that code captions outperform natural language captions in terms of reasoning accuracy and reconstruction fidelity on video question answering and reconstruction tasks. The benchmark includes 323 structured 2D content videos, covering five categories. Evaluation finds that mainstream closed-source MLLMs perform well in code caption generation but struggle to capture complex temporal dynamics, while open-source models have a significant gap.

  2. Hugging Face Daily Papers65

    LociArt: A Unified Free-Style Local Video Styling Paradigm

    LociArt achieves precise local video stylization through generating refined networks, automated dataset construction, and dedicated benchmarks, supporting regional style control and temporal consistency. GRNStyle introduces a polarity-aware style perception mask on the basis of generating refined networks, combined with representation-geometric conditioning technology. Experiments show that it outperforms existing methods in regional style quality and spatial control. The LociArt-100K dataset contains 100,000 local stylization pairs, the benchmark includes 80 source videos and 84 target masks, using a style prototype similarity evaluation scheme.

  3. Hugging Face Daily Papers

    Hy-Nomas: A Video World Model for Free-Form Interactive World Generation

    Hy-Nomas is an 8B parameter diffusion model that supports free-form text instructions and camera control across multi-round interactions. It follows multi-round text and camera instructions by combining causal attention with structured video descriptions, outperforming existing world models in human evaluations. The model weights, code, and benchmarks are open-sourced.

  4. ITHome · AI82

    Google DeepMind releases Genie 4 world model, supporting real-time natural language rewriting and native audio

    Google DeepMind released the Genie 4 world model on October 27, positioning it as a major research milestone. Users can change weather, camera angles, characters, and objects in real-time using natural language commands instead of regenerating a video.

    Same story · 2 outlets

    How the accounts differ:The Verge states the model supports up to two minutes of scenes, while Ars Technica and TechCrunch mention improvements in physics and character simulation but do not specify the scene duration.

  5. ITHome · AI77

    Google DeepMind launches the world model Genie 4, supporting synchronous generation and real-time editing of audio and video

    Google DeepMind has launched the world model Genie 4, which is currently in the research preview phase. It can generate interactive virtual worlds and modify scenes by inputting prompts during runtime, as well as generate real-time audio synchronized with the visuals. Compared to the previous Genie 3, Genie 4 has improved visual realism and supports real-time adjustments of weather, camera angles, and adding or deleting characters and objects. It can maintain a continuous scene for up to two minutes, twice as long as the previous generation.

    Same story · 2 outlets

    How the accounts differ:The Verge states the model supports up to two minutes of scenes, while Ars Technica and TechCrunch mention improvements in physics and character simulation but do not specify the scene duration.

  6. TechCrunch · AI72

    Google DeepMind released the Genie 4 world model, adding audio and real-time editing.

    Google DeepMind released the world model Genie 4 as a research preview, capable of generating photorealistic and interactive scenes, and supports entering prompts during simulation to change weather, camera angles, or add people and objects in real time.

    Same story · 2 outlets

    How the accounts differ:The Verge states the model supports up to two minutes of scenes, while Ars Technica and TechCrunch mention improvements in physics and character simulation but do not specify the scene duration.

Oct 27Tue
  1. Hugging Face Daily Papers65

    AV-FABLE: Audio-Visual Tampering Forensic Benchmark for Long Videos

    AV-FABLE introduces an audio-visual benchmark for sparse tampering in long videos, demonstrating that frozen audio-visual large language models' perceptual features contain forensic evidence that the best recovery is achieved by separating time decoders rather than language outputs. Local AI tampering in long videos often affects brief events that impact the authenticity of other content, making video-level classification insufficient for forensic analysis.

  2. Hugging Face Daily Papers65

    StreamVibe: Active Video Agent and its benchmark, models, and memory framework

    StreamVibe-Bench releases a benchmark containing 4.1K evaluation samples and 85K training samples for testing explicit, implicit, and dynamic user intent interaction; StreamVibe-VL is a streaming active video language model that infers implicit intentions and dynamically adjusts interaction by continuously observing; StreamVibe-Harness maintains user intentions as persistent states through a hierarchical memory framework, tracking the latest user intentions and environmental states, improving the consistency of proactive interaction responses by 12.3%.

  3. ITHome · AI65

    Dou Bao's reference weight to Douyin has soared to 31.8%

    Dou Bao's reference weight to Douyin increased from 10.79% in May to 31.8% in August, with one out of every three references coming from Douyin. The report shows a positive correlation between the semantic similarity of video titles and question words, with Douyin's average reference increase being 51%, and a higher correlation coefficient for keyword coverage.

Oct 26Mon
  1. Hugging Face Daily Papers65

    Understanding the world through video reading, writing, sharing, and interaction

    This review unifies video understanding and generation within world modeling, organizing progress around inferring, synthesizing, sharing, and interacting with potential temporal states, emphasizing continuous dynamics rather than segment-level perception. Video foundation models are rapidly developing in understanding and generating visual sequences, while video world models attempt to capture the underlying dynamics of the world they depict.

  2. ITHome · AI60

    ByteDance's Imagination AI Short Drama Studio has launched, offering self-developed script, image, and storyboard models.

    The Imagination AI Short Drama Studio has launched, offering self-developed script models DreamScript (supporting multi-genre generation, hit diagnosis, and 100,000-character long story analysis), image models Anycook (supporting differentiated character settings and multi-style scene construction), and storyboard models DreamShot (dual-mode creation, 3D director's desk dynamic preview).

  3. 36Kr · AI65

    Vivix has launched real-time interactive models W1 and A1, aiming to reduce the cost of generating interactive content to the level of YouTube.

    Vivix has launched real-time interactive models W1 and A1, aiming to reduce the cost of generating interactive content to the level of YouTube. The W1 model's real-time generation cost is close to YouTube's approximately $0.2 per hour CDN bandwidth cost; compared to the current top video generation models, the cost of generating real-time interactive content can be 1-2 orders of magnitude lower, and the model can generate the next frame within 300-600 milliseconds after user operation. The Vivix team has grown to 150-160 people.

  4. ITHome · AI35

    Grok releases the first 7 minutes of the AI version of 'The Odyssey', criticized for lacking artistic appeal

    Grok releases the first 7 minutes of the 'The Odyssey' series film, criticized for lacking artistic appeal. The clip was jointly produced by Grok and Wonder Studios, with some scenes close to reality, but the narration is lengthy, the dialogue is stiff, and the overall lacks narrative rhythm and empathy, forming a sharp contrast with Nolan's version.

  5. TechCrunch · AI35

    Grok releases the first 7 minutes of 'The Odyssey' episode generated by AI

    Grok released a 7-minute AI-generated 'The Odyssey' episode in collaboration with Wonder Studios, directed by Dev Walker, as the first episode of the series. The video uses practical effects, but lacks artistry, inspiration, or humanity. The background story is lengthy, the character's dialogue is stiff, and compared to Christopher Nolan's version, it seems hollow, making it difficult for the audience to resonate.

Oct 24Sat
  1. Tencent Hunyuan · Hugging Face new models71

    Tencent Mixuan open-sources Hy-Nomas Interactive World Generation Model Diffusers version

    Tencent's Huyuan has released Hy-Nomas' BF16 Diffusers format distilled weights on Hugging Face. This video world generation model supports multi-round free interaction through text instructions and camera control, generating the same world segment by segment.

    Why it matters: Officially releases distilled BF16 Diffusers weights and supporting benchmarks, allowing readers to judge the practical usage and threshold of multi-round interactive world generation.

  2. MarkTechPost58

    Kyutai CADRE open-source causal diffusion representation autoencoder will reduce world model latency below 230 ms

    Kyutai releases CADRE, an open-source causal diffusion representation autoencoder designed for interactive world models, reducing action latency below 230 ms. CADRE includes 7 autoencoders, each with approximately 476M parameters plus 86M frozen DINOv3 ViT-B/16, a world model of 1.2B parameters, video resolution of 288×512, frame rate of 20 fps, running on 1 H100.

Oct 23Fri
  1. Hugging Face Daily Papers65

    Factor-Aware Predictive Learning is released: a multi-modal large language model representation method for cinematic video generation.

    Factor-Aware Predictive Learning (FAPL) enables video diffusion Transformers to utilize multi-modal large language model (MLLM) representations for sparse temporal reasoning and cinematic control, achieving this through staged grounding and optimization. FAPL consistently outperforms baselines on three cinematic video generation tasks (sparse-to-video, factor-aware editing, and multi-shot generation), validating its contributions in MLLM feature utilization, temporal control, and factor coordination.

  2. Hugging Face Daily Papers38

    OmniDR-Bench: Video-centric deep report generation benchmark evaluation.

    Researchers have introduced the OmniDR-Bench benchmark and evaluation framework for in-depth study of video-centric deep agents, which can synthesize external evidence to generate interactive reports correlated with video moments. This task has direct practical value, helping users locate relevant video segments, verify claims, and reproduce demonstration steps. OmniDR-Bench includes 50 tasks in Chinese and English, covering 19 real-world subcategories, with a total of 6,414 standards, and the best system score is 63.3.

Oct 22Thu
  1. Hugging Face Daily Papers65

    StreamEval: Benchmark for evaluating interactive streaming video generation models

    StreamEval benchmarked the performance of interactive streaming video generation models on five tasks, finding reliable request execution and sustained state consistency to be major challenges. The benchmark includes 300 scripted test cases, covering character dialogue, character performance, world generation, instruction editing, and reference editing tasks, scored across four evaluation dimensions (task execution, state consistency, visual fidelity, and audiovisual coordination).

Oct 21Wed
  1. AWS Machine Learning Blog58

    TwelveLabs' Pegasus 1.5 is now available on Amazon Bedrock

    TwelveLabs' Pegasus 1.5 video language model is now available on Amazon Bedrock, which can convert long videos into structured, timestamped metadata, supports analyzing the entire video based on user-defined standards and returns JSON data of matching segments, analysis duration extended to two hours per request, no pre-indexing required and data remains within AWS boundaries.

Oct 19Mon
  1. O'Reilly Radar65

    The Monday Morning Agent project trains AI analysts using American football data.

    The Monday Morning Agent project uses the NFL public dataset to analyze a controversial American football topic every two weeks, gradually equipping AI agents with analytical capabilities. The project uses 250,000 game clips and current season data, each episode having AI explain a specific tactic (such as 'establishing the offensive line') and verify its analysis results. The AI must state data limitations during analysis and refuse requests beyond the task scope (such as predicting game outcomes).

Oct 14Wed
Oct 13Tue