AWS Machine Learning Blog3434AtScale as a semantic layer constructs dimensional models on Amazon Redshift using Semantic Modeling Language (SML), supporting Strands agents in Amazon Bedrock AgentCore to achieve cross-system Customer 360 analysis.
AWS Machine Learning Blog3434Strategy Mosaic, as a semantic layer, models C360 domains on Amazon Redshift and Amazon Aurora without ETL using two linked models. Its metric syntax captures the business definition of agent reasoning and exposes the model to AgentCore-hosted Strands agents via the Mosaic MCP server, supporting user identity propagation to achieve end-to-end row-level and object-level security.
AWS Machine Learning Blog4040Eon replaced its local Model Context Protocol (MCP) server with Amazon Bedrock AgentCore Gateway, integrating cross-AWS, GCP, and Azure operational tool access into a single authentication gateway, reducing new engineers' investigation tool configuration time from 2 days to 2 minutes.
AWS Machine Learning Blog4848Keyfactor EJBCA integrated with AWS services provides identity authentication for AI agents through X.509 Public Key Infrastructure (PKI), addressing the issue of lacking built-in authentication standards when MCP connects to external tools.
AWS Machine Learning Blog3131Canadian organizations can use OpenAI GPT-5.6, GPT-6, and GPT-6.1 models on Amazon Bedrock in the Canadian (Central) and Canadian West (Calgary) regions to achieve cross-region inference.
AWS Machine Learning Blog3838The Octave Reliance team built a three-tier secure multi-tenant AI infrastructure based on Cohere Embed v4 on Amazon Bedrock to solve the knowledge island problem in regulatory industry quality management, reducing deployment time by 50%.
AWS Machine Learning Blog4040GPT-OSS-20B is an open-source inference model that thinks in English by default, and only 22% met the target language requirements in multilingual inference tests. By using supervised fine-tuning (SFT) and reinforcement learning (GRPO) on Amazon SageMaker HyperPod, the team can improve the model's inference capabilities in French, German, Spanish, and Italian, where SFT is responsible for primary behavior teaching and GRPO optimizes when there is room for improvement.
AWS Machine Learning Blog3838Amazon Quick combined with Amazon Bedrock AgentCore provides supply chain teams with real-time data access across systems. Users can get cross-system answers in seconds through conversational queries, such as identifying high-income SKUs and costs affected by port closures. Quick serves as the interface layer, and AgentCore as the intelligence layer, connecting backend systems like ERP, monitoring, and procurement via the MCP protocol to achieve a complete process from problem discovery to generating emergency purchase requests, all operations requiring manual confirmation.
AWS Machine Learning BlogSmartsheet launches Universal Model Context Protocol (MCP) Server, enabling AI assistants to read/write manage Smartsheet data via standardized protocol, supporting operations on tables, rows, columns, and automation for over 40 tools
AWS Machine Learning Blog3939i14 deploys its 24-layer decoder Laplace 3B (3,072D parameters, using Gated Linear Attention architecture) to AWS Trainium2, achieving a training speed of 120,000 tokens per second and concurrent inference capability for 11,544 output tokens.
GitHub Blog · AI & ML2222Three Java masters Vlad Mihalcea, Patrick Baumgartner, and Frank Delporte shared their experience using GitHub Copilot in projects such as Hypersistence Utils, Hypersistence Optimizer, and teaching slide migration.
Databricks BlogDatabricks has integrated the RFD4-Proteina model into Genesis Workbench, supporting execution in AI runtime environments and connecting research data and workflows. Developers can build and adjust pipelines using Genie Code and the NVIDIA BioNeMo Agent Toolkit, leveraging serverless NVIDIA GPU computing for protein design.
vLLM BlogAnt Group and the vLLM community open-source Humming, a high-performance quantized inference kernel library. Humming supports NVIDIA GPUs starting from the Turing architecture and CUDA-compatible devices like the T-Head Zhenwu 810E, providing extensive quantization support covering various integer and floating-point types, bit widths, and scaling schemes. It significantly outperforms existing implementations such as vLLM Marlin, FlashInfer, and DeepGEMM on multiple representative workloads.
Google Developers BlogAgents CLI 1.5.0 version introduces an extension system, allowing developers to override or add commands without modifying the tool, supporting cross-framework usage; the official LangChain extension replaces framework-bound commands while retaining other lifecycle functionalities; developers can create custom extensions, such as adding deployment commands for software bill of materials (SBOM) scanning, enabling enterprise platform teams to enforce governance policies.
Apple Machine Learning ResearchTEAL has for the first time efficiently applied active learning to the token space of ViT for low-budget pixel-level semantic segmentation, boosting mIoU by +24.36 on datasets like CamVid and Cityscapes with only one pixel labeled per image, and achieving full-supervised performance of 97% with 10 pixels labeled.
Databricks BlogDatabricks introduces Agent Memory, which improves agent quality, reduces costs and latency by storing key facts, preferences, and processes, and supports running on Lakebase. It is currently in Beta version. Agent Memory is based on Databricks' latest memory research and uses the MemCurrent architecture. In internal benchmark tests, it has tripled the pass rate of agent tasks while reducing token usage by 31%.
OpenAI Alignment Blog5050OpenAI has introduced the complementary metric g-mean² to improve model monitorability evaluation. g-mean² calculates TPR and TNR through behavioral labels and monitoring predictions, but cannot solve the problems of mixed differences in different model tasks and deployment risks. The new metric includes a paired matching metric for aligned shared instances and a post-control integrated metric simulating monitoring rejection of outputs, to more comprehensively evaluate model deployment risks.
Hugging Face Blog5858ALTK-Evolve uses GPT-4.1 to learn and apply customer service scripts. In the τ²-bench customer service agent benchmark test, it surpasses all retail entries in the retail sector, achieving a score of 67.5% Pass^4, and does not require updating model weights. The model is based on a basic ReAct agent and GPT-4.1. It attempts to analyze tasks and use GPT-4.1 to distill success and failure into short behavioral rules, then adds these guidelines to the agent's system prompts without updating weights or manual annotation.
Mistral AIMistral AI has launched Voxtral 3, which includes an advanced voice model capable of real-time multi-step conversations in over 50 languages, along with a voice agent SDK. Its voice-to-text model, Voxtral Small Transcribe 3, achieved a Forced WER of 0.9% on the FLEURS 45 benchmark.
IBM Research BlogThe llm-d project announces the release of version 1.0, which is a Kubernetes-native distributed inference service network that supports deploying any model's inference stack on any accelerator in any cloud. This version enhances multi-tenant quality of service, zero-downtime operations, and agent-aware services to achieve continuous performance in common production operations. Through techniques such as prefix cache-aware routing and KV cache offloading, llm-d 1.0 can capture 97% of available cache reuse, reducing the cost of large-scale AI services.
Hugging Face Blog5858AnyLanguageModel 1.0 is released, supporting local model advancements on Apple platforms for a year. New support added for cloud models such as OpenAI Chat Completions, Anthropic Messages, and Google Gemini. Local model support includes llama.cpp, MLX, and Core ML. Tool calling and guided generation features are expanded. Cloud models have the same functionality as local models, and API keys support dynamic acquisition through closures.
Google Developers BlogGoogle has released the native PyTorch backend for vLLM and SGLang inference engines, supporting TPU and optimizing production-level services; vLLM-TorchTPU achieved a cost of 2.01 cents per million tokens for 175B parameter models in the SemiAnalysis InferenceX benchmark, leading the industry.
vLLM BlogvLLM TorchTPU (vllm-torchtpu) released, enabling vLLM to run on Google Cloud TPU, supporting Pallas core's attention, Mixture-of-Experts, and quantized matrix multiplication while maintaining the vLLM experience, supporting six-dimensional parallelism, and recommending TPU v7x (Ironwood).
Anthropic ResearchGoogle Developers BlogCoral NPU has released a complete 32-bit architecture, including new matrix execution units, supporting up to 1 TOPS performance and 10mW average power consumption; launched the Coral Compiler v1.0 based on IREE/MLIR.
Google Developers BlogArm leveraged the hierarchical graph visualization and plugin architecture of Google AI Edge Model Explorer to develop open-source adapters supporting formats such as TOSA, VGF, and PTE, helping developers more easily inspect edge model conversion processes.
Hugging Face BlogHugging Face has released TorchTPU, making TPU a native backend device for PyTorch. Transformers, Diffusers, and Kernels can now run directly on TPU. Users only need to select a model from the Hugging Face Hub and specify device_map="tpu".
Meta EngineeringGenRecs Tokenization enhances conversion rates by 0.35% for advertisers by representing items like ads and products with a stable semantic vocabulary, combined with Meta's Generative Ad Model (GEM) and adaptive ranking model. This technology leverages the world knowledge of pre-trained large models to enable recommendation systems to understand preferences of new items or users with no historical interaction, accelerates learning through shared concepts, achieves cross-activity transfer, and improves performance as large model scale increases, forming a feedback loop for performance improvement.
Meta EngineeringMeta engineers built a lean router with 1,300 lines to assign over 20 workflows to 14 specialized AI agents, with the router itself not performing any domain-specific tasks, significantly improving the efficiency and accuracy of data pipeline agents.
Sakana AI5555Sakana AI proposed 'QD-Rec', recommending candidate-hypothesis pairs as units, with generative AI writing new hypotheses based on past excellent hypotheses in a cycle to accumulate high-quality and diverse recommendations. Experiments were conducted in M&A, customer targeting, and paper recommendations, achieving high average evaluations in many settings and building large sets of recommendations.
LangChain BlogNu company, while developing AI health coach Nu, prioritized building evaluation criteria to avoid boundary-crossing medical diagnoses. Using the LangGraph framework and LangSmith tools, it ensures the system meets health guidance needs while complying with regulatory requirements through LLM judges scored by category and open-ended behavior tests. The evaluation framework is designed separately for single responses and complete conversations, supporting rapid migration between two leading model providers. Safety probes and guard nodes review conversation content in real-time, ensuring the product stays within compliance boundaries.
IBM Research Blog2222Coursera's new course 'AI Data Stream Architecture: From Principles to Practice' teaches engineers how to work across GPUs, TPUs, Cerebras WSE, Groq LPU, and IBM Spyre accelerators. The course is taught by Kaoutar El Maghraoui, a senior research scientist at IBM Research, covering execution models, compilation, memory systems, debugging, and performance modeling through six courses and hands-on experiments, emphasizing how different architectures affect model performance and the key role of compiler optimization.
Tencent Hunyuan · Hugging Face new modelsThe Hy-Memory-30B-A3B-GGUF model quantization file released by Tencent's Huayan uses a hybrid precision quantization scheme with imatrix calibration and MoE perception, achieving efficient local inference on llama.cpp, where the ~8 GB expert-mixed build file size is reduced to about 24.71 GB, with performance only 1.53% lower than Q6_K.
vLLM BlogvLLM achieves a downtime reduction of DeepSeek V4 Pro from 16GB200 to 20GB200 to 0.82 seconds and from 20GB200 back to 16GB200 to 1.96 seconds through asynchronous preparation and NIXL EP technology.
Google Developers BlogLiteRT Tensor API is released, supporting developers to write and optimize models natively in C++ on edge devices, enabling cross-platform deployment (CPU/GPU/NPU) without script conversion. Developers can fully control the computational graph structure and directly load model weights, achieving zero-copy data transfer through shared accelerator buffers, while providing building blocks for AI coding agents.
Hugging Face BlogTorchNeuron provides a new native backend for PyTorch on AWS Trainium, with native support for Transformers, Diffusers, and Kernels, making it unprecedentedly easy to run models on Trainium and share models on HF Hub.
Google Developers BlogUsing ADK and Gemini 3.8, non-blocking voice interaction is implemented through streaming tools and asynchronous functions, reducing the first response time of the sales report workflow from 14.4 seconds to 1.2 seconds, supporting zero silence, progress updates, and parallel conversations.
MiniMax NewsMiniMax M3.1 Flash is officially launched, with nearly a threefold increase in online inference speed and a 70% reduction in cost compared to the previous generation. The model performs excellently in benchmark tests for complex intelligent tasks (cowork), computer use, software development, and network security, ranking highly in the AutomationBench-AA for automated tasks, scoring 73.7% on DeepSWE v1.1, 61.7 on OSWorld V2, 29.6 on ALE, and 82% on CyberGym.
Ollama BlogCloudflare's 27B multimodal decision model Clef has landed on the Ollama cloud platform, users can run it locally or use cloud services. Clef transforms state and typed question patterns into decisions, supports text and image input, is compatible with Jev and System One APIs, is fine-tuned based on Qwen3.8-27B, and adopts the Apache 2.0 license. In Cloudflare's decision index evaluation, Clef outperforms Jev and performs leading in most benchmark tests.
