Apple has new Mac app coming to make running local AI models easy

Leaker Aaron Perris has discovered evidence of a new Mac app in the works at Apple called Harbor, which makes it easy to run local AI models across one or more Macs.

New ‘Harbor’ app revealed at Apple: ‘turns your Mac into a private AI inference server’

The Mac has been getting a lot more popular this year, both because of budget-friendly options like MacBook Neo but also as a tool for running AI models locally on Mac Studio, Mac mini, and more.

It seems Apple plans to lean harder into the latter use case, as leaker Aaron Perris has discovered a new Mac app called Harbor that’s been designed to turn your Mac into a private AI inference server.

Here’s Perris’s post on X with the details:

As the post notes, here’s what the app does:

Harbor turns your Mac into a private AI inference server. Run open-weight models locally on Apple silicon—your data never leaves your hardware, and nothing reaches the cloud. Connect multiple Mac computers over Thunderbolt 5 to pool unified memory, enabling large models and higher concurrency that a single computer can handle alone.

And here are the feature highlights:

• Setup in minutes, not hours: “Harbor automatically detects your devices over Thunderbolt 5 to form a cluster. Plug in, start, and you’re running—no manual configuration, no command line, no infrastructure expertise required.”
• Download and run models directly: “Browse, download, and load open-weight models from within the app. Harbor handles model management so you can focus on the work, not the setup.”
• Cluster for scale: “Connect two or more Thunderbolt 5-capable Mac computers and Harbor pools their unified memory into a single inference resource. Run models that exceed any single computer’s capacity, or serve more concurrent requests across your cluster.”

Harbor is currently in a private preview under Apple’s Claris brand, but it seems likely that we’ll see it launch to the public in the weeks and months ahead.

Are you interested in using Harbor on your Mac? Let us know in the comments.

Best Mac accessories

• AirPods Pro 3 (now only $199, down from $249)
• Logitech MX Master 4 Mouse
• 100W USB-C fast charging power adapter
• tomtoc protective MacBook sleeve bag
• Twelve South aluminum laptop stand for MacBooks

FTC: We use income earning auto affiliate links. More.