How to Run Local AI in ONLYOFFICE on Ubuntu Using Ollama

Unlock Local AI Power: Edit Documents on Ubuntu with ONLYOFFICE and Ollama

Are you a Linux enthusiast seeking to harness the power of AI directly on your Ubuntu machine for document editing? Imagine having a smart writing assistant at your fingertips, without sending your data to external servers. This guide will walk you through integrating ONLYOFFICE Desktop Editors, a robust open-source office suite, with Ollama, an innovative platform for running local LLMs. Discover how this powerful combination brings AI-powered document editing to your desktop, offering unparalleled privacy, control, and efficiency for all your text, spreadsheet, and presentation needs. Get ready to transform your workflow!

Seamlessly Integrate Local LLMs for Enhanced Productivity on Ubuntu

Leveraging local AI for document editing provides significant advantages, especially for tech-savvy Linux users prioritizing privacy and control. Unlike cloud-based AI services, running local LLMs with platforms like Ollama ensures your sensitive data never leaves your machine. This guide focuses on integrating Ollama with ONLYOFFICE Desktop Editors on Ubuntu, offering a powerful, private, and customizable AI assistant right within your familiar open-source office suite.

Step 1: Install ONLYOFFICE Desktop Editors on Ubuntu

First, let’s set up ONLYOFFICE Desktop Editors, a feature-rich open-source office suite renowned for its native compatibility with Microsoft Office formats (Word, Excel, PowerPoint), making it an excellent alternative for Linux users.

Effortless ONLYOFFICE Installation

The most efficient way to install ONLYOFFICE Desktop Editors on Ubuntu is by adding its official repository. Follow these commands in your terminal:

1. Create GPG Keyring Directory and Add GPG Key:
   bash
   mkdir -p -m 700 ~/.gnupg
   gpg –no-default-keyring –keyring gnupg-ring:/tmp/onlyoffice.gpg –keyserver hkp://keyserver.ubuntu.com:80 –recv-keys CB2DE8E5
   chmod 644 /tmp/onlyoffice.gpg
   sudo chown root:root /tmp/onlyoffice.gpg
   sudo mv /tmp/onlyoffice.gpg /usr/share/keyrings/onlyoffice.gpg

2. Add the Application’s Repository:
   bash
   echo ‘deb [signed-by=/usr/share/keyrings/onlyoffice.gpg] http://download.onlyoffice.com/repo/debian squeeze main’ | sudo tee -a /etc/apt/sources.list.d/onlyoffice.list

3. Update Package Manager Cache:
   bash
   sudo apt-get update

4. Complete the Installation:
   bash
   sudo apt-get install onlyoffice-desktopeditors

Once installed, you can launch ONLYOFFICE Desktop Editors by typing desktopeditors in your terminal or finding it in your application menu. You’ll be ready to create new documents or open existing files stored locally on your Ubuntu system.

Unique Tip: For users who prefer containerized solutions or direct binaries, ONLYOFFICE also offers AppImage and Snap packages, providing alternative installation routes that can be simpler for some users. Check their official documentation for detailed instructions.

Step 2: Deploy Ollama for Local LLM Power

Next, we’ll install Ollama, an incredible open-source platform specifically designed to run large language models (LLMs) locally on your Linux machine. This step is crucial for unlocking Ubuntu AI capabilities.

Essential Hardware Considerations for Local LLMs

While Ollama makes running LLMs accessible, keep in mind that these models can be resource-intensive. RAM is the primary concern; while some compact models might run with 16 GB, more sophisticated LLMs often require 32 GB or even 64 GB of RAM for optimal performance. Evaluate your hardware before selecting larger models.

Effortless Ollama Setup

To install Ollama on Ubuntu, simply open your terminal and execute this command:

bash
curl -fsSL https://ollama.com/install.sh | sh

This script automates the installation process. For advanced users seeking fine-tuned performance with specific drivers, a manual installation method with additional packages is detailed in the Ollama documentation on GitHub.

Choosing and Running Your First LLM

After installation, start the Ollama service:

bash
ollama serve

Now, browse the extensive Ollama library (ollama.com/library) to find an LLM that fits your needs. As an example, let’s deploy the deepseek-r1 model, known for its strong performance:

bash
ollama run deepseek-r1

Ollama will download and run the model. Once complete, you can interact with it via the terminal. However, our goal is to integrate this powerful local LLM directly into ONLYOFFICE for document editing.

Step 3: Integrate Ollama with ONLYOFFICE via the AI Plugin

ONLYOFFICE Desktop Editors supports integration with third-party services and AI platforms through its robust plugin architecture. We’ll use the dedicated AI plugin to connect with your locally running Ollama model.

Installing the AI Plugin

1. Open ONLYOFFICE Desktop Editors.
2. Navigate to the Plugins tab.
3. Click on Plugin Manager.
4. In the built-in marketplace, search for and install the "AI" plugin.

After installation, activate the plugin by accessing the Background plugins menu on the Plugins tab and toggling the AI slider to "On." A new "AI" tab will appear on your top toolbar.

Configuring Ollama as Your AI Provider

With the AI plugin activated, it’s time to tell it to use your local Ollama model:

1. Go to the newly added AI tab and click Settings.
2. In the AI configuration window, click Edit AI model and then Add.
3. Select Ollama from the list of AI providers.
4. Ensure the URL parameter is http://localhost:11434 (Ollama’s default API address).
5. Leave the Key field blank.
6. In the Model field, specify deepseek-r1:latest (or the name of your chosen Ollama model).
7. Click OK.

Finally, return to the main AI configuration menu. You can now select your newly added Ollama model (deepseek-r1:latest) as the preferred LLM for various tasks like "Ask AI," "Summarization," "Translation," and "Text analysis." This allows you to assign specific local models to different jobs, maximizing your AI-powered document editing efficiency.

Step 4: Master AI-Powered Document Creation and Editing

Your AI assistant powered by Ollama is now ready to revolutionize your document editing experience within ONLYOFFICE. Access its features via the "AI" tab or the context menu to supercharge your productivity:

• Grammar and Spelling: Flawlessly check and correct your text.
• Content Refinement: Lengthen, shorten, or completely rewrite passages with ease.
• Knowledge Base: Instantly find definitions of words, concepts, or historical facts.
• Content Generation: Generate new text content, brainstorm ideas, or draft entire sections.
• Seamless Translation: Translate text within your document without needing external tools.
• Interactive Chat: Engage with your local LLM in a separate window for general queries or creative prompts.

This powerful combination of ONLYOFFICE and Ollama puts advanced AI-powered document editing at your fingertips, entirely on your Ubuntu system.

Conclusion

By integrating Ollama with ONLYOFFICE Desktop Editors, you’ve unlocked a potent suite of AI tools that run entirely locally on your Ubuntu machine. This setup empowers you with advanced capabilities for editing documents, spreadsheets, presentations, and PDF files, all while maintaining complete control over your data and ensuring privacy. The freedom to choose any local LLM from Ollama’s diverse library means you can tailor your AI assistant to your exact needs, limited only by your hardware’s capacity.

Embrace the future of AI-powered document editing on Linux. Now that you know how to enable this robust solution on Ubuntu, experiment with different local LLMs and share your feedback to help evolve the open-source community’s capabilities.

FAQ

Question 1: What are the primary benefits of using local AI for document editing with ONLYOFFICE and Ollama?
Answer 1: The main benefits include enhanced privacy and data security, as all processing occurs on your local machine without sending data to external servers. You also gain offline access to powerful AI tools, greater control over the models you use, and the flexibility to customize your AI assistant to your specific workflow within an open-source office suite.

Question 2: What hardware specifications, particularly RAM, are recommended for running local LLMs effectively with Ollama on Ubuntu?
Answer 2: While compact local LLMs might run with a minimum of 16 GB of RAM, for a smoother experience and to run more sophisticated models like the example deepseek-r1, 32 GB of RAM is highly recommended. For very large or high-performance models, 64 GB or more will provide the best experience and prevent performance bottlenecks.

Question 3: Can I use different local LLMs for various tasks within ONLYOFFICE’s AI plugin, or am I limited to one model?
Answer 3: Yes, the ONLYOFFICE AI plugin is highly flexible! After installing multiple local LLMs via Ollama, you can configure the AI plugin settings to assign different models to specific tasks (e.g., one model for summarization, another for translation, and a third for general "Ask AI" queries). This allows you to leverage the strengths of various models, optimizing your AI-powered document editing workflow.

Read the original article