Skip to content
Live

Fields

On-device AI

AI running on mobile phones, computers, and edge devices: advancements in small models, local inference, and edge-side chips.

13featured stories
11this month
13 Nov, 14:34Updated
Active this month

Latest stories

Nov 13Fri1–12
  1. Hacker News · AI hot posts86

    Edge0 open sources 145B and 120B edge-side models and inference frameworks.

    Edge0 open-sourced the Edge0-145B and Edge0-120B two edge models, and also released a unified inference framework and deployment tools. Officially, the 145B model can run locally on compatible laptops, with peak memory of 29GB, decoding speed of 80+ tokens/s, pre-filling speed of 1100+ tokens/s, supporting context lengths of 128K–256K.

    Why it matters: The original text provides actual memory, speed, and multiple benchmark comparisons of the edge 145B model, which can be used to judge the practical boundaries of running cutting-edge models locally.

Nov 6Fri
  1. Google Research72

    Google Research uses smartwatch sensors to identify signs of hypertension.

    Google Research published a multimodal AI system AI-PPG-ACC-HTN in Nature, which passively identifies hypertension status without wristband calibration, using only PPG and accelerometer data from consumer-grade smartwatches.

    Why it matters: The study passively identifies hypertension using PPG and accelerometer data from smartwatches, providing quantitative results for screening and confirmation in two stages, with 24-hour dynamic blood pressure monitoring as the gold standard.

Nov 5Thu
  1. Hugging Face Blog72

    Phonon TTS releases on-device speech models, topping multiple metrics on the Hugging Face open TTS leaderboard

    Phonon releases a small TTS model that can run on local devices, without a server and network, offering two versions of about 65 MB and 75 MB, covering English, French, German, Spanish, and Portuguese.

    Why it matters: The original text outlines the specifications, open-source license, and leaderboard performance of on-device TTS models, allowing judgment on the usability boundary of small models in local voice scenarios.

Nov 4Wed
  1. 36Kr · AI72

    After the decision model became popular, why does the physical world need fast on-device judgment?

    TypeSafeAI released decision model Jev in mid-September, which only outputs yes/no, scores, or probabilities, and within weeks of launch, user numbers broke a million, with about one-third of Fortune 500 companies starting to use it, and its valuation increased from about $200 million to $7.5 billion in 24 days.

    Why it matters: From the explosion in popularity of decision models to on-device judgment in the physical world, it shows an industrial change in AI capabilities shifting from generation to measurable decision-making.

Oct 30Fri
  1. ITHome · AI78

    Xiaomi open-sources 0.8B document understanding model Xiaomi-OCR-0, supporting Markdown and JSON output

    Xiaomi open-sources lightweight document understanding model Xiaomi-OCR-0, with 0.8B parameter size, weights and inference code have been uploaded to Hugging Face and GitHub, a single model covers three tasks of document parsing, key information extraction, and OCR visual question answering.

    Why it matters: 0.8B parameters rank second on the overall list in OmniDocBench v1.6, and weights, MCP services, and Skill toolkits are also opened, which can be used to judge the boundary of small models for document parsing.

Oct 29Thu
  1. QbitAI72

    Tenstorrent releases Tianhe 300 and Tongyang TY1200, on-site actual test targets NVIDIA H200 and Thor T5000.

    Tenstorrent releases cloud-based general-purpose GPU Tianhe 300 and edge product Tongyang TY1200 based on the Tianshu architecture, and compares them with NVIDIA H200, Jetson Thor T5000 on-site with random questions.

    Why it matters: On-site random tests, dual-track comparison of cloud and edge against NVIDIA, and providing reproducible test numbers and software stack implementation methods.

Oct 28Wed
  1. ITHome · AI72

    Days Smart Chip Tianya 300 runs its first prototype, claims single-card throughput reaches 1.05 times that of NVIDIA H200

    Days Technology Core first publicly demonstrates Tianji 300 general GPU prototype running on October 28th Shanghai media open day, claiming it as the first general GPU in China with actual performance reaching NVIDIA H200 level. Third-party actual testing converts single card overall throughput to 1.05 times that of H200, but specific testing methods, model loads, and workload conditions have not been announced.

    Why it matters: Days Technology Core first publicly demonstrates Tianji 300 prototype running, providing throughput comparison with H200 and super-node cost estimation, allowing observation of domestic GPU's ground progress.

  2. Hugging Face Blog76

    Liquid AI releases LFM3 series: Same 2B backbone derived text, visual, audio, multimodal and decision models

    Liquid AI releases the new generation Liquid Foundation Models, LFM3, deriving six 2B-level models from the shared backbone LFM3-1.7B-Base, covering text, vision, audio, multimodal, and decision, all open weights on Hugging Face.

    Why it matters: Liquid AI derives six modality models from the same 2B-level backbone and provides single-card fine-tuning and edge deployment paths, which can be used to judge the specialization route for small models.

Oct 26Mon
Oct 22Thu
  1. The Decoder74

    Recursive releases its first model developed in collaboration with Eureka Machine

    AI startup Recursive has released its first language model, Flint. During the development process, the AI system named Eureka Machine participated in proposing ideas, building, testing, and planning subsequent experiments.

    Why it matters: Recursive publicly announces its first model developed with the assistance of an automated research system, allowing readers to observe how far AI-assisted R&D can go.

Aug 12Wed
  1. Liquid AI Blog71

    Liquid AI releases edge-side visual language model LFM2.5-VL-3B

    Liquid AI releases LFM2.5-VL-3B, an upgraded 3.1B edge-side visual language model based on its predecessor LFM2-VL-3B, now available on Hugging Face and Playground

    Why it matters: The original text provides 28 benchmark items, edge-side, and GPU throughput data, which can be used to compare with similar-sized competitors to determine the actual position of this 3B visual model.

Aug 4Tue
  1. Liquid AI Blog71

    Liquid AI releases edge AI agent model LFM2.5-2.6B

    Liquid AI has released LFM2.5-2.6B, which is an intelligent agent model that runs entirely on the device and can complete planning, tool calls, and multi-step tasks. Both the base and fine-tuned versions are now available on Hugging Face.

    Why it matters: The original text provides the complete training process for the edge AI agent model and multi-benchmark comparisons, allowing you to judge the actual position of small models running AI agents locally.

Related topics

AI agents116 this monthOpen source76 this monthDeployment & infra62 this monthSafety & alignment56 this monthReasoning37 this monthMultimodal34 this month

Related terms from the glossary

LFM37 related stories