開發人員: Ashraf Samy (12)
價錢: * 免費
排名: 0 
評測: 0 寫評論
清單: 0 + 0
點數: 0 + 0 ¡
Mac App Store

描述

Inferencer - Private AI Studio
Inferencer lets you run, host and deeply control the latest SOTA AI models (OSS, DeepSeek, Qwen, Kimi, GLM and more) from your own computer.
No data is sent to the cloud for processing - maintaining your complete privacy.
Advanced inferencing controls give you complete control on their accuracy and outputs.

Models
Start in the models section where you can select the location of existing models or download new ones directly from Hugging Face.
Use the distributed compute feature to load a model across two Macs, or use the model streaming feature to inference larger models partially from storage.

Chats
Select the model to interact with on the top menu bar and write a prompt to begin. At any point you can switch between models and continue the chat to see what else they can uncover. You can also selectively delete past messages to keep the model focused and less scatterbrain.

Chat Controls
Control the inferencing parameters including batching to inference multiple chats at the same time, intensity of processing, and model streaming to load models larger than available memory.

Token Entropy and Inspection
Select the inspectors to peek into the inner-workings of each word outputted and see the model's confidence levels and alternative choices.

Prompt Framing
Expanding the prompt section to utilise the framing feature which allows you to control the output the model generates.

Tools
The tools editor allows you to enable built in tools such as get_webpage_content or add in your own, so that models can use them when needed. For example, if you'd like a webpage or search result inferenced, simply enable the tool in the Tools section, and allow tool calls in the chat settings panel.

Server
If enabled, the server feature allows you to serve and connect to your own or trusted devices. No data is sent elsewhere. Also includes compatible APIs for application development.

Distributed Inference
With distributed compute you can link together two Macs, sharing the memory to inference larger models. To use make sure it's enabled in both the app and server settings. Once a connection to your server is made, if both the computers have the same model, a distributed compute icon will appear. Simply tap on it to load the model for distributed compute.

Coding Tools
Built-in support for Xcode Intelligence and Visual Studio Code. Use the server feature with Compatibility APIs enabled and SSL disabled to allow Xcode or Visual Studio Code to use Inferencer as a service provider.

Shortcuts
Use the Shortcuts app to automate inferencing workflows (e.g., copy text from clipboard > inference > speak result).

Settings
Includes parental controls, an automatic deletion policy and more.

Privacy
For maximum privacy, all AI processing happens offline and on your device, by default.

Subscriptions
Basic (Free): Most features unlocked for free including unlimited chats.
Professional: Upgrade for more advanced token inspection, prompt-framing and model streaming.

Terms & Support
Terms of Use: inferencer.com/terms
Privacy Policy: inferencer.com/privacy

Disclaimer
Inferenced models may not always be accurate or contextually appropriate. You are responsible for verifying the information before making important decisions.
更多 ↓

螢幕擷取畫面

#1. Inferencer - Private AI Studio (macOS) 由: Ashraf Samy
#2. Inferencer - Private AI Studio (macOS) 由: Ashraf Samy
#3. Inferencer - Private AI Studio (macOS) 由: Ashraf Samy
#4. Inferencer - Private AI Studio (macOS) 由: Ashraf Samy
#5. Inferencer - Private AI Studio (macOS) 由: Ashraf Samy
#6. Inferencer - Private AI Studio (macOS) 由: Ashraf Samy

新功能

  • 版本: v1.8.0
  • 發佈日期:
  • + New batching engine allows multiple generations to be inferenced at the same time
    + Support for Devstral-2
    + End of stream token added to token inspector - allows bypassing the conversation end
    + Fixes for Multi-window sessions
    + More support for edge case LaTeX
    + More bug fixes and performance improvements

價錢

追蹤票價

開發人員

點數

0 ☹️

排名

0 ☹️

清單

0 ☹️

評測

成為第一個評論 🌟

其他資訊

Inferencer - Private AI StudioInferencer - Private AI Studio 縮短網址: 已複製!
  • 🌟 分享
  • Mac App Store

你可能還喜歡

    • AI Pro: Private AI Assistant
    • macOS 應用程式: 生產應用  由: Crypto Inc.
    • 免費  
    • 清單: 1 + 2  排名: 0  評測: 0
    • 點數: 16 + 201 (4.7)  版本: 3.0.3   AI Pro is the essential ChatGPT client for your Apple ecosystem. Enjoy seamless conversations with GPT 4.1 on your iPhone, iPad, Mac, and Apple Vision Pro, with iCloud sync ensuring ...
        ⥯ 
    • AI Chat: Super AI Assistant
    • macOS 應用程式: 生產應用  由: SevenSeas AI Studio
    • * 免費  
    • 清單: 0 + 0  排名: 0  評測: 0
    • 點數: 1 + 0  版本: 1.0.1   Discover the ultimate AI assistant on Mac, designed to boost your productivity, creativity, and problem-solving skills. Built on GPT-4o, Gemini, and DeepSeek, our app delivers seamless
        ⥯ 
    • Private AI Rewriter
    • macOS 應用程式: 生產應用  由: David ROTHSCHILD
    • $0.99  
    • 清單: 0 + 0  排名: 0  評測: 0
    • 點數: 1 + 0  版本: 1.0.1   Rewrite text quickly, easily privately, on your device. PrivateAI-Rewriter uses Apple Intelligence to transform your writing into the style you choose all processed completely on your ...
        ⥯ 
    • Patagonia Chat - Private AI
    • macOS 應用程式: 生產應用  由: Matias Villaverde
    • 免費  
    • 清單: 0 + 1  排名: 0  評測: 0
    • 點數: 16 + 30 (3.9)  版本: 3.1.0   # Patagonia AI Chat Your Private AI, Always Available Patagonia AI Chat puts powerful AI in your pocket completely offline and 100% private. Whether you're summarizing reports, ...
        ⥯ 
    • Local AI Studio
    • macOS 應用程式: 生產應用  由: 强 李
    • $9.99  
    • 清單: 0 + 0  排名: 0  評測: 0
    • 點數: 0 + 0  版本: 1.1   Discover the cutting-edge capabilities of Local AI Studio, empowering you to harness the full potential of AI, local LLM chat, automatic speech recognition (ASR) and Stable Diffusion ...
        ⥯ 
    • Local Chat: Private AI Chatbot
    • macOS 應用程式: 生產應用  由: Superabundant
    • 免費  
    • 清單: 0 + 1  排名: 0  評測: 0
    • 點數: 0 + 44 (4.5)  版本: 2025.24   Local Chat allows you to run the latest open language models on your Mac, iPad, and iPhone. Once you've downloaded the models, you can use the chat function even when your device is ...
        ⥯ 
    • OfflineLLM: Private AI Chat
    • macOS 應用程式: 生產應用  由: Bilaal Rashid
    • $5.99  
    • 清單: 0 + 0  排名: 0  評測: 0
    • 點數: 0 + 8 (3.0)  版本: 4.0.1   OfflineLLM uses a custom execution engine for LLMs, optimised specifically for Apple Silicon on iPhone, iPad, Mac and Vision Pro. Using the full power of Metal 3, OfflineLLM is able to
        ⥯ 
    • ment - private ai chat
    • macOS 應用程式: 生產應用  由: ment.tools
    • 免費  
    • 清單: 0 + 0  排名: 0  評測: 0
    • 點數: 0 + 0  版本: 1.0   Discover a new way to interact with AI on your Mac. ment lets you chat with a smart, customizable assistant--completely free and with no limits on your conversations. Thanks to a ...
        ⥯ 
    • LocalMotion: Private AI
    • macOS 應用程式: 生產應用  由: Guap Inc.
    • 免費  
    • 清單: 0 + 0  排名: 0  評測: 0
    • 點數: 0 + 0  版本: 1.0.0   # Run LLM Chat on your own device locally! ** Powered by Mistral-7B-v0.1 ** ** As model uses 8gb-ram, 16gb-ram is recommended **
        ⥯ 
    • AI Chat Studio: AI Assistant
    • macOS 應用程式: 生產應用  由: Tahir Pasha
    • * 免費  
    • 清單: 0 + 0  排名: 0  評測: 0
    • 點數: 2 + 0  版本: 1.1.6   AI Studio for Mac is the ultimate AI-powered workspace, combining creativity, productivity, and intelligence into one sleek Mac-native application. Designed for creators, ...
        ⥯ 
    • AI Podcast Studio Voice Studio
    • macOS 應用程式: 生產應用  由: Usama Daood
    • * 免費  
    • 清單: 0 + 0  排名: 0  評測: 0
    • 點數: 0 + 0  版本: 1.2   AI Podcast Creator is an all-in-one podcast creation tool that allows anyone to create studio-quality podcasts using the power of artificial intelligence no microphone, no recording ...
        ⥯ 

你可能還喜歡

可搭配 AppAgg 使用的搜尋運算子
添加到 AppAgg
AppAgg
立即免费注册
註冊
登入