MineContext is your proactive context-aware AI partner（Context-Engineering+ChatGPT Pulse）

MineContext：Create with Context,Clarity from Chaos

An open-source,proactive context-aware AI partner,dedicated to bringing clarity and efficiency to your work, study and creation.

Report Issues · Feedback

中文 / English

👋 Join our WeChat / Lark / Red Note Group

🌍 Join our Discord Group

App Download for Mac

Table of Contents

• 👋🏻 What is MineContext
• 🚀 Key Features
• 🏁 Quick Start
  • 1. Installation
  • 2. Disable the quarantine attribute
  • 3. Enter Your API Key
  • 4. Start Recording
  • 5. Forget it
• 💎 The Philosophy Behind the Name
• 🎯 Target User
• 🔌 Context-Source
• 🆚 Comparison with Familiar Application
  • MineContext vs ChatGPT Pulse
  • MineContext vs Dayflow
• 🏗️ Backend Architecture
  • Core Architecture Components
  • Layer Responsibilities
• 🚀 Backend Usage
  • Installation
  • Configuration
  • Running the Server
• 👥 Community
  • Community and Support
• Star History
• 📃 License

MineContext is a proactive context-aware AI partner. By utilizing screenshots and content comprehension (with future support for multi-source multimodal information including documents, images, videos, code, and external application data), it can see and understand the user's digital world context. Based on an underlying contextual engineering framework, it actively delivers high-quality information such as insights, daily/weekly summaries, to-do lists, and activity records.

MineContext focuses on five key features: effortless collection, intelligent resurfacing, and proactive delivery.

1. 📥 Effortless Collection Capable of gathering and processing massive amounts of context. Designed storage management enables extensive collection without adding mental burden.
2. 🚀 Proactive Delivery Delivers key information and insights proactively in daily use. It extracts summarized content from your context—such as daily/weekly summaries, tips, and todos—and pushes them directly to your homepage.
3. 💡 Intelligent Resurfacing Surfaces relevant and useful context intelligently during creation. Ensures assisted creativity without overwhelming you with information.
4. 🛡️ Privacy-First All data is stored locally, ensuring your privacy and security.
5. 🎯 Context Engineering Architecture Supports the complete lifecycle of multimodal, multi-source data—from capture, processing, and storage to management, retrieval, and consumption—enabling the generation of six types of intelligent context.

Click Github Latest Release to Download

Enter the following command in the terminal to disable the quarantine attribute before running the application.

sudo xattr -d com.apple.quarantine "/Applications/MineContext.app"

After the application loads（initial run may require installation of some backend environments, which may take a few minutes）, follow the instructions to enter your API. We currently support Doubao and OpenAI, with more platforms and local Ollama models to be added in the future.

Considering both cost and performance, we recommend using the Doubao model. The Doubao API Key can be generated in the API Management Interface.

After obtaining the Doubao API Key, you need to activate two models in the Model Activation Management Interface: the Visual Language Model and the Embedding Model.

• Visual Language Model: Doubao-Seed-1.6-flash

• Embedding Model: Doubao-embedding-large

The following is the filling process after obtaining the API Key:

Enter 【Screen Monitor】 to enable the system permissions for screen sharing. After completing the setup, you need to restart the application for the changes to take effect.

After restarting the application, please first set your screen sharing area in 【Settings】, then click [Start Recording] to begin taking screenshots.

After starting the recording, your context will gradually be collected. It will take some time to generate value. So, forget about it and focus on other tasks with peace of mind. MineContext will generate to-dos, prompts, summaries, and activities for you in the background. Of course, you can also engage in proactive Q&A through [Chat with AI].

The naming of MineContext also reflects the team's ingenuity. It signifies both "my context" and "mining context." It draws inspiration from the core philosophy of Minecraft—openness, creativity, and exploration.

If vast amounts of context are like scattered "blocks," then MineContext provides a "world" where you can freely build, combine, and create. Users can reimagine and create new content based on the collected massive context and generate high-quality information.

We will prioritize the expansion of Context Sources according to the following plan, and we warmly welcome everyone to actively contribute code to our efforts.

• P0: Digital life and public information loop (PC screen capture and link upload)
• P1: Personal text context loop (file upload, file tracking)
• P2: AI and common office context loop (MCP, meeting notes)
• P3: High-quality information acquisition loop (DeepResearch and RSS)
• P4: Personal deep context loop (WeChat, QQ chat data acquisition, mobile screenshots)
• P5: Physical world context loop (smart wearable synchronization, smart glasses synchronization)

• 🖥️ Comprehensive Digital Context: MineContext captures your entire digital workflow by reading from screen screenshots, providing a rich, visual context of your daily activities and applications. ChatGPT Pulse, in contrast, is limited to the context of a single text-based conversation.
• 🔒 Local-First Data & Privacy: Your data is processed and stored entirely on your local device, ensuring complete privacy and security without relying on cloud servers. ChatGPT Pulse requires data to be sent to and stored on OpenAI's servers.
• 🚀 Proactive & Diverse Insights: MineContext delivers a wider variety of intelligent, auto-generated content—including daily summaries, actionable todos, and activity reports—not just simple tips. ChatGPT Pulse primarily offers reactive assistance within the chat interface.
• 🔧 Open Source & Customizable: As an open-source project, MineContext allows developers to freely inspect, modify, and build upon the codebase for complete customization. ChatGPT Pulse is a closed, proprietary product with no option for modification.
• 💰 Cost-Effective API Usage: MineContext avoids the need for a costly $200/month Pro subscription by allowing you to use your own API key, giving you full control over your spending. ChatGPT Pulse's advanced features are locked behind its expensive premium tier.

• 💡 Richer, Proactive Insights: ineContext delivers a more diverse range of automated, intelligent content—including concise summaries, actionable todos, and contextual tips—going beyond basic activity tracking. DayFlow primarily focuses on logging user activity.
• 🧠 Context-Aware Q&A & Creation: MineContext enables you to ask questions and generate new content based on your captured context, unlocking wider application scenarios like content drafting and project planning. DayFlow is limited to passive activity recording and review.
• ✨ Superior Activity Generation & Experience: MineContext produces activity records with greater clarity and detail, featuring a more intuitive and interactive dashboard for a seamless user experience. DayFlow's activity logs are more basic with limited interactivity.

MineContext adopts a modular, layered architecture design with clear separation of concerns and well-defined responsibilities for each component.

opencontext/
├── server/             # Web server and API layer
├── managers/           # Business logic managers
├── context_capture/    # Context acquisition modules
├── context_processing/ # Context processing pipeline
├── context_consumption/# Context consumption and generation
├── storage/            # Multi-backend storage layer
├── llm/               # LLM integration layer
├── tools/             # Tool system
└── monitoring/        # System monitoring

1. Server Layer (server/)

   • FastAPI-based RESTful API
   • WebSocket support for real-time communication
   • Static file serving and template rendering

2. Manager Layer (managers/)

   • CaptureManager: Manages all context capture sources
   • ProcessorManager: Coordinates context processing pipeline
   • ConsumptionManager: Handles context consumption and generation
   • EventManager: Event-driven system coordination

3. Context Capture Layer (context_capture/)

   • Screenshot monitoring
   • Document monitoring
   • Extensible capture interface for future sources

4. Processing Layer (context_processing/)

   • Document chunking strategies
   • Entity extraction and normalization
   • Context merging and deduplication
   • Multi-modal content processing (text, images)

5. Storage Layer (storage/)

   • Multi-backend support (SQLite, ChromaDB)
   • Vector storage for similarity search
   • Unified storage interface

6. LLM Integration (llm/)

   • Support for multiple LLM providers (OpenAI, Doubao)
   • VLM (Vision-Language Model) integration
   • Embedding generation services

We recommend using uv for fast and reliable package management:

# Clone repository
git clone https://github.com/volcengine/MineContext.git
cd MineContext

# Install uv (if not already installed)
curl -LsSf https://astral.sh/uv/install.sh | sh

# Sync dependencies (automatically creates virtual environment)
uv sync

1. Basic Configuration (config/config.yaml):

server:
  host: 127.0.0.1
  port: 8765
  debug: false

embedding_model:
  provider: doubao  # options: openai, doubao
  api_key: your-api-key
  model: doubao-embedding-large-text-240915

vlm_model:
  provider: doubao  # options: openai, doubao
  api_key: your-api-key
  model: doubao-seed-1-6-flash-250828

capture:
  enabled: true
  screenshot:
    enabled: true # enable screenshot capture
    capture_interval: 5  # capture interval in seconds

2. Prompt Templates (config/prompts_*.yaml):
   • prompts_en.yaml: English prompt templates
   • prompts_zh.yaml: Chinese prompt templates

# Start with default configuration
uv run opencontext start

# Start with custom config
uv run opencontext start --config /path/to/config.yaml

# Start with custom port (useful for avoiding conflicts)
uv run opencontext start --port 8000

Available Options:

• --config: Path to configuration file
• --host: Host address (default: from config or localhost)
• --port: Port number (default: from config or 8000)

Priority: Command-line arguments > Config file > Default values

Alternatively, you can activate the virtual environment manually:

source .venv/bin/activate  # On Windows: .venv\Scripts\activate
pip install -e .
opencontext start --port 8000

• GitHub Issues: Errors and issues encountered while using MineContext.
• Email Support: Feedback and questions about using MineContext.
• WeChat Group: Discuss SwanLab usage and share the latest AI technologies.

This repository is licensed under the Apache 2.0 License.