Skip to content
Live
Official sources#Multimodal
Oct 23Fri
  1. Tencent Hunyuan · Hugging Face new models

    Tencent Mixuan releases WeVisOne-VL-4B unified visual language model

    Tencent Mixuan released the WeVisOne-VL-4B model, built on Qwen3-VL, integrating a 9.6M parameter pixel decoder, supporting object-level perception (open-vocabulary object detection, pointing localization, counting, pointing and OCR) and pixel-level perception (pointing segmentation and promptable alpha friction), suitable for research tasks such as visual localization, pointing, counting, OCR localization, pointing segmentation, and image friction.

  4. Hugging Face Blog

    Hugging Face releases OlmoEarth v1.3: Global satellite embedding model achieves new milestones

    Hugging Face releases OlmoEarth v1.3, a satellite embedding model, offering global pre-computed embeddings (10m resolution, 64 and 128 dimensions), available to users without login or technical knowledge. The model performs best in 27 evaluations, with 128-dimensional embeddings scoring highest in 20 evaluations and 64-dimensional embeddings leading in 18. Training costs are reduced by 53% compared to v1.2 and 18% compared to v1, with corresponding reductions in carbon emissions. Weights, data, and code are all open source.

  5. Google Developers Blog

    Google API Gateway supports streaming: Real-time AI-ready APIs without changing specifications.

    Google API Gateway now supports streaming, allowing real-time API calls without changing the specification. Streaming supports Server-Sent Events (SSE), chunked transfer encoding, HTTP response streaming, and WebSocket, with the longest connection time up to one hour. During the public preview, the streaming feature was enabled when creating the gateway using the `--enable-streaming` flag, and it is planned to be automatically enabled in the official release without additional configuration.

Oct 22Thu
  4. Tencent Hunyuan · Hugging Face new models72

    Tencent Mixuan open-sourced the real-time simultaneous translation model Hy-SimulMT-30B-A3B

    Tencent Mixuan has released and open-sourced the real-time simultaneous translation model Hy-SimulMT-30B-A3B, supporting bidirectional Chinese-English voice-to-voice translation, capable of continuously outputting translated text and speech during speech, and supporting real-time voice cloning.

    Why it matters: The official provides a comparison of latency and quality for real-time simultaneous translation, and opens up multiple quantitative versions and inference deployment scripts, which can be used to evaluate the deployment cost.

Oct 21Wed
  1. Mistral AI50

    Mistral collaborates with NVIDIA to advance AI in engineering

    Mistral is collaborating with NVIDIA to integrate AI models with NVIDIA accelerated computing and physics modeling tools, accelerating engineering simulations and enabling closed-loop AI-driven design. The collaboration will launch public benchmarks and open datasets, standardizing the evaluation of physics and agent AI in computer-aided engineering, and leveraging NVIDIA Omniverse for 3D simulations and resource creation.

  2. NVIDIA Blog58

    NVIDIA European partners expand computing capabilities, building sovereign, open, and secure AI agent cloud ecosystems.

    NVIDIA European partners are expanding regional computing capabilities to support model training and inference, helping developers build agentic and physical AI applications. Nscale achieves 37% more GPUs and 50% higher inference throughput using the NVIDIA DSX platform, Crusoe develops a liquid-cooled AI factory for low-latency inference, and Nebius adopts the NVIDIA Groq 3 LPX to accelerate sensitive applications.

  3. NVIDIA Blog

    NVIDIA showcased its full lineup of local AI hardware: RTX Spark, DGX Spark, and DGX Station, helping to power next-generation intelligent agents.

    NVIDIA showcased its full lineup of local AI hardware at GTC Berlin, with RTX Spark now available to support personal agents on Windows PCs, DGX Spark enabling developers to build and scale Linux applications, and DGX Station designed for Linux enterprise teams to run cutting-edge workloads, with the Windows version launching in December.

  4. AWS Machine Learning Blog58

    vLLM enhances the TTFT performance of multi-round agent workloads through bidirectional KV transmission.

    vLLM's bidirectional KV transmission mechanism reduces redundant calculations by allowing the decoding node to return previously computed KV cache to the pre-filled node in subsequent dialogue turns. In multi-round benchmark tests on AWS EC2 P5en instances, it improved the TTFT of Qwen3-32B by 1.6x and zai-org/GLM-5-FP8 by 3.3x. This feature is implemented by extending the NIXL KV connector and utilizing a KV cache-aware router to coordinate KV reuse across dialogue turns.

  6. AWS Machine Learning Blog58

    TwelveLabs' Pegasus 1.5 is now available on Amazon Bedrock

    TwelveLabs' Pegasus 1.5 video language model is now available on Amazon Bedrock, which can convert long videos into structured, timestamped metadata, supports analyzing the entire video based on user-defined standards and returns JSON data of matching segments, analysis duration extended to two hours per request, no pre-indexing required and data remains within AWS boundaries.

  8. AWS Machine Learning Blog34

    Building an AI agent semantic layer on AWS using Strategy Mosaic and Amazon Bedrock AgentCore.

    Strategy Mosaic, as a semantic layer, models C360 domains on Amazon Redshift and Amazon Aurora without ETL using two linked models. Its metric syntax captures the business definition of agent reasoning and exposes the model to AgentCore-hosted Strands agents via the Mosaic MCP server, supporting user identity propagation to achieve end-to-end row-level and object-level security.

  13. AWS Machine Learning Blog40

    Fine-tune GPT-OSS-20B on Amazon SageMaker HyperPod for multilingual inference

    GPT-OSS-20B is an open-source inference model that thinks in English by default, and only 22% met the target language requirements in multilingual inference tests. By using supervised fine-tuning (SFT) and reinforcement learning (GRPO) on Amazon SageMaker HyperPod, the team can improve the model's inference capabilities in French, German, Spanish, and Italian, where SFT is responsible for primary behavior teaching and GRPO optimizes when there is room for improvement.

  14. AWS Machine Learning Blog38

    How Amazon Quick and Amazon Bedrock AgentCore implement conversational intelligent decision-making in supply chains

    Amazon Quick combined with Amazon Bedrock AgentCore provides supply chain teams with real-time data access across systems. Users can get cross-system answers in seconds through conversational queries, such as identifying high-income SKUs and costs affected by port closures. Quick serves as the interface layer, and AgentCore as the intelligence layer, connecting backend systems like ERP, monitoring, and procurement via the MCP protocol to achieve a complete process from problem discovery to generating emergency purchase requests, all operations requiring manual confirmation.

  16. Databricks Blog

    Deploy RFD4-Proteina on Databricks

    Databricks has integrated the RFD4-Proteina model into Genesis Workbench, supporting execution in AI runtime environments and connecting research data and workflows. Developers can build and adjust pipelines using Genie Code and the NVIDIA BioNeMo Agent Toolkit, leveraging serverless NVIDIA GPU computing for protein design.

  17. vLLM Blog

    Ant Group and the vLLM community open-source Humming: A general-purpose high-performance quantized inference kernel library

    Ant Group and the vLLM community open-source Humming, a high-performance quantized inference kernel library. Humming supports NVIDIA GPUs starting from the Turing architecture and CUDA-compatible devices like the T-Head Zhenwu 810E, providing extensive quantization support covering various integer and floating-point types, bit widths, and scaling schemes. It significantly outperforms existing implementations such as vLLM Marlin, FlashInfer, and DeepGEMM on multiple representative workloads.

Oct 20Tue
  2. Hugging Face Blog58

    AnyLanguageModel 1.0 is released: supporting local model advancements on Apple platforms for a year.

    AnyLanguageModel 1.0 is released, supporting local model advancements on Apple platforms for a year. New support added for cloud models such as OpenAI Chat Completions, Anthropic Messages, and Google Gemini. Local model support includes llama.cpp, MLX, and Core ML. Tool calling and guided generation features are expanded. Cloud models have the same functionality as local models, and API keys support dynamic acquisition through closures.

  4. Meta Engineering

    Meta introduces GenRecs Tokenization to reshape ad recommendations with a stable model vocabulary.

    GenRecs Tokenization enhances conversion rates by 0.35% for advertisers by representing items like ads and products with a stable semantic vocabulary, combined with Meta's Generative Ad Model (GEM) and adaptive ranking model. This technology leverages the world knowledge of pre-trained large models to enable recommendation systems to understand preferences of new items or users with no historical interaction, accelerates learning through shared concepts, achieves cross-activity transfer, and improves performance as large model scale increases, forming a feedback loop for performance improvement.

Oct 19Mon
  2. Sakana AI55

    Sakana AI proposes 'QD-Rec' to improve recommendation quality and diversity with an open-ended exploration method

    Sakana AI proposed 'QD-Rec', recommending candidate-hypothesis pairs as units, with generative AI writing new hypotheses based on past excellent hypotheses in a cycle to accumulate high-quality and diverse recommendations. Experiments were conducted in M&A, customer targeting, and paper recommendations, achieving high average evaluations in many settings and building large sets of recommendations.

  3. LangChain Blog

    How Nu company builds AI health coaches using LangGraph and LangSmith and prioritizes evaluation

    Nu company, while developing AI health coach Nu, prioritized building evaluation criteria to avoid boundary-crossing medical diagnoses. Using the LangGraph framework and LangSmith tools, it ensures the system meets health guidance needs while complying with regulatory requirements through LLM judges scored by category and open-ended behavior tests. The evaluation framework is designed separately for single responses and complete conversations, supporting rapid migration between two leading model providers. Safety probes and guard nodes review conversation content in real-time, ensuring the product stays within compliance boundaries.