Skip to content
Live
Official sources#Engineering
Oct 25Sun
  1. vLLM Blog60

    vLLM serves DeepSeek-V4.1-Flash on GB300 NVL72: performance matches DeepInfer and extends to the entire rack

    The vLLM team used P/D separation and Wide-EP to serve DeepSeek-V4.1-Flash on a single NVIDIA GB300 NVL72 rack, achieving 954K tokens/s per GPU and 196 tokens/s for single-user P90 on SemiAnalysis AgentX, which is 7.9 times the early single-node results.

    Why it matters: The vLLM team has released per-item optimization and measured data for serving DeepSeek-V4.1-Flash on GB300 NVL72, which can be compared with DeepSeek's own engine DeepInfer.

Oct 24Sat
  1. vLLM Blog62

    vLLM provides an in-depth explanation of the optimization of PCP, DCP, and Hybrid HiSparse for GLM-5.3 on 16 H200s

    vLLM team releases the second part of GLM-5.3 optimization, deploying on 16 H200s with 1 pre-filled node and 1 decoding node, using PCP to split pre-fill by token and DCP to split KV cache by token, allowing 1M context to fit into the pre-fill node

    Why it matters: The vLLM team has dissected how PCP, DCP, and Hybrid HiSparse can be combined on 16 H200s, allowing readers to understand the memory and pre-fetch bottlenecks of long-context deployment.

  3. Databricks Blog58

    Spark's declarative pipelines: Use cases designed for AI agents

    Spark's declarative pipelines are 34 times faster than imperative pipelines in 22 data engineering tasks, halve the code volume, and have fewer errors. Declarative pipelines capture structural errors in advance through pre-execution validation and offload repetitive tasks like sorting and result saving to Spark, while imperative pipelines need to run on the cluster until the error step to detect them. The two methods perform equally in terms of logical error rates, but declarative pipelines have more concise and consistent code, making them easier to maintain.

  4. Google Research62

    Google Research is advancing tuberculosis screening implementation with foundational models.

    Google Research introduced the path of its tuberculosis screening AI from research to clinical use at IDWeek 2026: publishing a benchmark in Radiology in 2019, completing multi-center prospective validation in NEJM AI in 2024, and then converting it into a clinical tool certified by CE MDR Class IIb through Nexus AI.

    Why it matters: Google Research outlined the complete path from imaging benchmark to CE certification tool to open-source MedGemma, allowing readers to understand the stages medical AI needs to cross to move from papers to clinical use.

  7. AWS Machine Learning Blog

    Use AWS CDK custom resources to orchestrate SageMaker AI endpoint auto-scaling.

    Use AWS CDK custom resources to automatically orchestrate SageMaker AI endpoint updates with auto-scaling, without manual intervention. Through three custom resources (decommission, update, register scalable targets, attach extension policies) achieve explicit dependency order, ensuring endpoint configuration and auto-scaling parameters are synchronized in a single deployment. The deployment stack includes three custom resources, two Step Functions state machines, and twelve Lambda functions.

  9. Amazon Science

    Audible's technology team has developed a new controllable speech synthesis technology to enhance the experience of audiobooks.

    Audible's technology team has developed a new controllable speech synthesis technology, by combining large language models (LLMs) and three innovative technologies to enhance the experience of audiobooks: 1) Develop a data synthesis pipeline to generate speech data with voice feature descriptions, train the model to understand the descriptions and generate matching audio; 2) Create an automatic system to analyze book characters and identify dialogues, with an accuracy of 97%, to provide stage directions for the model; 3) Improve the dialogue discrimination by 3.7 points in MUSHRA tests, and significantly improve the sound experience in English and Spanish tests by 80%.

  10. Hugging Face Blog

    LitPivot: Developing research ideas through dynamic context in the literature landscape

    LitPivot helps researchers adjust their research direction by reading previous literature, dividing research ideas into problems, contributions, and evaluation plans, and providing literature-based criticism and revision suggestions for each section. In a laboratory study involving 17 researchers, domain experts rated the literature foundation of novel ideas developed using LitPivot better than ideas developed using text editors and AI chat tools. Participants also reported stronger literature comprehension and improved understanding of the novelty and practicality of their ideas.

Oct 23Fri
  2. Sakana AI

    Sakana AI has launched the Sakana Aquarium AI agent platform based on ontology.

    Sakana AI has launched the Sakana Aquarium platform for building, executing, and running AI agents. It integrates organizational information through ontology, supporting the efficient construction and secure operation of AI agents. The platform includes three core mechanisms: ontology, governance, and agent execution base, achieving systematic organizational judgment criteria and task automation.

  4. Amazon Science

    Amazon Science releases TorchNeuron: A PyTorch backend for AWS Trainium chips

    Amazon Science releases the open-source backend TorchNeuron, which translates PyTorch code into executable instructions for the AWS Trainium system, supporting existing PyTorch code to run on Trainium. It achieves efficient execution through optimizations like adaptive eager mode and multi-level cache, and uses an AI agent to screen 841 representative models and tens of thousands of tensor dimensions for benchmark testing.

  5. Databricks Blog60

    Databricks Talks AI Billing: How to Reduce the Unit Cost of Coding Agents by 90%

    Databricks executive Patrick reviews the process where the cost of AI coding agents increased exponentially after the company fully adopted them, and then reduced the unit cost by up to 90% by controlling the layer. He mentions that shifting traffic to cheaper new models contributed to more than 50% of the reduction, and Smart Router reduced the average task cost by more than 30% while maintaining near the quality of the most expensive model. This internal solution was later productized as Unity Gateway, which is now used by thousands of customers.

    Why it matters: Databricks executive reviews the process of its own AI coding costs from out of control to reducing the unit cost by 90%, providing migratable practices for gateways, routing, and self-built evaluations.

  6. Databricks Blog38

    Fraud Analyst AI Coworker: Detect telecom fraud in real-time on a single platform.

    Fraud Analyst AI Coworker can detect telecom fraud in real-time on a single platform. The AI addresses the shortcomings of traditional fraud detection systems in terms of architecture through techniques such as cross-channel correlation, behavioral modeling, and device simulation. Its context window covers 6-7 system data sources, with a speed increase of 3.4 times, but the original text does not mention specific parameter scale, benchmark scores, price, and availability (open source/closed source/API).

  10. Microsoft Research58

    Flint-interactive: A language for creating interactive data visualizations

    Flint-interactive makes AI-generated charts highly interactive, allowing users to explore data through clicks, filtering, zooming, highlighting, and cross-chart interactions. It simplifies the construction of complex interactions through advanced semantic events and update operations, and leverages the Flint compiler to handle interaction logic and visual dependencies, enhancing reliability and development efficiency. Flint-interactive supports creating interactive data stories, dashboards, and connected experiences, enabling AI agents to generate charts with interactive features to help users analyze data more efficiently.

  11. AWS Machine Learning Blog34

    How Rescale uses Strands Agents and AI-DLC to build intelligent AI routing agents

    Rescale utilizes Strands Agents and the AI-DLC framework to set up intelligent routing agents on AWS in five days and deploy them in production within weeks. The agent classifies end-to-end test failures at night by calling Claude Opus 4.8, retrieves historical failure patterns from the knowledge base, queries MCP logs for runtime evidence, and generates remediation reports containing file references, function names, and recommended fixes for engineers to review.

  12. Hugging Face Blog

    Hugging Face releases OlmoEarth v1.3: Global satellite embedding model achieves new milestones

    Hugging Face releases OlmoEarth v1.3, a satellite embedding model, offering global pre-computed embeddings (10m resolution, 64 and 128 dimensions), available to users without login or technical knowledge. The model performs best in 27 evaluations, with 128-dimensional embeddings scoring highest in 20 evaluations and 64-dimensional embeddings leading in 18. Training costs are reduced by 53% compared to v1.2 and 18% compared to v1, with corresponding reductions in carbon emissions. Weights, data, and code are all open source.

  13. Google Developers Blog

    Google API Gateway supports streaming: Real-time AI-ready APIs without changing specifications.

    Google API Gateway now supports streaming, allowing real-time API calls without changing the specification. Streaming supports Server-Sent Events (SSE), chunked transfer encoding, HTTP response streaming, and WebSocket, with the longest connection time up to one hour. During the public preview, the streaming feature was enabled when creating the gateway using the `--enable-streaming` flag, and it is planned to be automatically enabled in the official release without additional configuration.

Oct 22Thu
  2. Google DeepMind

    Google DeepMind releases Forest Typology (ForTy) 2020 global forest type map

    Google DeepMind and Google Research jointly release the Forest Typology (ForTy) 2020 Global Map, which classifies every 10x10 meter land on Earth into six types of forests and land use, and tracks changes from 2017 to 2025. The map is based on definitions by the United Nations Food and Agriculture Organization, accurately distinguishing native forests, plantations, monoculture forest plantations, economic crop forests, and other land types, supporting the EU's deforestation regulations with an accuracy of 90%.

  3. NVIDIA Newsroom76

    NVIDIA releases OpenShell reference architecture for enterprise security agents

    NVIDIA releases the OpenShell reference architecture, based on the OpenShell secure runtime software, integrating Vera Rubin inference infrastructure, Vera CPU runtime intelligence framework, and the Sentry security framework on BlueField-4 DPU, and can be extended to the edge via RTX Spark, DGX Spark, and DGX Station.

    Why it matters: The original text provides the full-stack architecture composition for secure operation of enterprise agents and the first batch of partners, allowing readers to judge the implementation form of enterprise-level agent governance.

  7. NVIDIA Blog

    NVIDIA helps Europe's retail industry transform: from digital discovery to physical operations.

    European retailers are leveraging open models and physical intelligence, such as e-commerce platforms that reduce inference costs by 90%, and distribution centers that simulate collaboration of different robot fleets through digital twins. Shopify uses NVIDIA-accelerated open models to integrate NVIDIA Nemotron 3.5 Lightning into the GraphQL sub-agent of Sidekick through post-training, achieving a 90% cost reduction and a 7-fold increase in response speed.

  9. NVIDIA Blog

    NVIDIA Cosmos platform expands new tools to train, evaluate, and deploy world models

    NVIDIA expands the Cosmos platform with new training tools, simulation checkpoints, and Cosmos Data Factory blueprints to help developers quickly build world models. Cosmos Data Factory provides 5 cloud-native blueprints, supporting tasks such as autonomous driving data generation and image attribute enhancement through channels like GitHub and Azure, with Porsche and ANYbotics already applying them to accelerate physical AI development.

Oct 21Wed
  1. OpenAI News62

    OpenAI models will go live on Google Cloud

    OpenAI Collaborates with Google Cloud, Integrating OpenAI Frontline Models and Codex Workflows into Gemini's Model Garden and Offering Through Google Cloud Marketplace

    Why it matters: OpenAI's cutting-edge models and Codex workflow enter Google Cloud's Model Garden, providing a new entry point for cross-cloud distribution for readers to explore.