MacOS Desktop App with AI Integration & Local LLM Execution


Project Overview: We are seeking an experienced developer (or team) to build a MacOS desktop application that seamlessly integrates advanced AI functionalities. This app will serve as a powerful tool for on-demand AI assistance, local model execution, and real-time text processing—without a web-based interface. Key Features & Requirements: 1. Onboarding & Setup: - Develop an intuitive walkthrough and onboarding process to guide users through obtaining necessary permissions. - Integrate with Ollama for downloading and managing AI models. - Implement a default installation of Qwen 2.5 7B with a prompt warning for larger models (DeepSeek v3/r1) regarding performance impact and storage. 2. User Authentication & Synchronization: - Redirect users to an external login/signup system (via Supabase or Clerk) for authentication. - Synchronize desktop app settings with external accounts, retrieving preferences such as custom key binds, shortcuts, custom contexts, model selections, and API keys (for Alibaba Cloud, Anthropic, and OpenAI). 3. User Interaction Features: - System-wide Popup Window: - Develop a popup window that activates through a custom key bind on selected text across the Mac. - Include a toggle between a chat interface and a direct text completion mode. - Ensure the popup is draggable, auto-hides when not in use, or when the text field is empty, and closes on Esc. - Autocompletion: - Implement a feature to trigger text completions based on the current window context. - Support completion suggestions in non-writable fields (e.g., PDFs) via a chat-like interface. 4. Background Processes & Analytics: - Maintain background processes to continuously check for updates from an external settings database (Supabase). - Collect and store analytics data such as usage statistics, model performance, and user interactions. 5. Open-Source LLM Integration & Custom Features: - Allow users to download and locally run open-source AI models (e.g., Qwen, DeepSeek, Llama). - Enable model execution by simply highlighting text and pressing a custom key. - Implement persistent context management that saves up to 5 contexts for use across different tasks, with a cursor AI-like interface for easy context selection. - Automatically detect system specs to choose the optimal AI model for local execution, ensuring high performance, privacy, and offline functionality. - Enable dynamic model switching based on task requirements, with user-settable preferences in the settings. 6. Custom API Integration & Shortcuts: - Allow users to integrate their own API keys for services like GPT, Claude, and Gemini. - Enable creation of custom keyboard shortcuts (using keys like Control, Option, or Command) to execute frequent prompts instantly. 7. Cursor-Based Suggestions: - Provide smart suggestions at the cursor by analyzing preceding text, enhancing the user’s productivity in real-time. Tech Stack & Tools: - Development Environment: Xcode (Swift) for MacOS desktop app development. - Backend Integration: Supabase for settings synchronization and analytics. - AI Model Management: Integration with Ollama for downloading and verifying model installations. Project Deliverables: - A fully functional MacOS desktop app with the features described above. - Comprehensive documentation detailing installation, configuration, and usage instructions. - Source code with inline documentation. - Support and maintenance plan for post-deployment updates. Application Process: Please provide examples of previous MacOS desktop projects, especially those involving AI integrations or similar advanced functionalities. Include a brief outline of your development approach, timeline, and estimated cost. We look forward to collaborating with a talented freelancer who can bring this innovative AI desktop app to life!

Keyword: cloud

 

Senior Software Engineer

Our Start-up client in the Cannabis industry is looking to hire the fourth Software Engineer to the team! They are looking for someone that is ready to hit the ground running with endless opportunity for growth, promotion, and adapting to the newest technologies. They a...

View Job
Website & App Development with AI and API Integration

We're creating an AI-powered job-seeking platform that automates job applications, matches candidates to jobs, and provides interview coaching. We integrate AI, job board APIs, Google Cloud services, and payment gateways to streamline the job search process. We’re look...

View Job
Deploy ML Model on AWS with Time Series CSV Training & Inference Pipeline

Project Overview: I’m looking for an experienced AWS + Machine Learning + DevOps engineer to build a fully automated ML pipeline on AWS. The project involves loading a machine learning model (of my choice), training it on time series CSV data, running inference via API,...

View Job