「大模型」3小时完全从0训练26M的小参数GPT,个人显卡即可推理训练! "大道至简" 中文 | English 本开源项目旨在完全从0开始,最快仅用3小时!即可训练出仅为26.88M大小的微型语言模型MiniMind。 MiniMind极其轻量,最小版本体积约是 GPT3 的 $\frac{1}{7000}$,力求做到最普通的个人GPU也可快速推理甚至训练。 MiniMind发布了大模型极简结构,数据集清洗和预处理、监督预训练(Pretrain)、有监督指令微调(SFT)、低秩自适应(LoRA) 微调,无奖励强化学习直接偏好对齐(DPO)的全阶段代码,也包含拓展共享混合专家(MoE) 的稀疏模型;拓展视觉多模态VLM: MiniMind-V。 这不仅是一个开源模型的实现,也是入门大语言模型(LLM)的教程。 希望此项目能为研究者提供一个抛砖引玉的入门示例,帮助大家快速上手并对LLM领域产生更多的探索与创新。 为防止误读,「最快3小时」是指您需要具备>本人硬件配置的机器,具体规格的详细信息将在下文提供。 …
How to run an Ink NodeInk Node Forked and customized from https://github.com/smartcontracts/simple-optimism-node A simple docker compose script for launching full / archive node for the Ink chain. Recommended Hardware Mainnet 16GB+ RAM 2 TB SSD (NVME Recommended) 100mb/s+ Download Testnet 16GB+ RAM 500 GB SSD (NVME Recommended) 100mb/s+ Download Installation and Configuration Install docker and docker compose Note: If you're not logged in as root, you'll need to log out and log i…
Ink DocumentationInkChain Documentation App An advanced, streamlined documentation platform built with Next.js and Nextra for InkChain. 🚀 Build & Run Build Docker image: docker build -t docs . Run Docker container: docker run -p 3000:3000 docs 📋 Requirements Node.js: v20.11.0 or higher 📖 Overview This is a documentation application powered by Nextra and built on Next.js. Nextra simplifies the creation of documentation sites, allowing us to leverage the Pages Router for efficient nav…
Instant Upgrades and Automated Refactoring of any PHP 5.3+ codeRector - Instant Upgrades and Automated Refactoring Rector instantly upgrades and refactors the PHP code of your application. It can help you in 2 major areas: 1. Instant Upgrades Rector now supports upgrades from PHP 5.3 to 8.4 and major open-source projects like Symfony, PHPUnit, and Doctrine. Do you want to be constantly on the latest PHP and Framework without effort? Use Rector to handle instant upgrades for you. 2. Automated…
Official Zigbee2MQTT Home Assistant add-on Official Zigbee2MQTT Home Assistant add-on Installation If you don't have an MQTT broker yet; in Home Assistant go to Settings → Add-ons → Add-on store and install the Mosquitto broker add-on, then start it. Go back to the Add-on store, click ⋮ → Repos…
A minimalistic AI-powered search engine that helps you find information on the internet. Powered by Vercel AI SDK! Search with models like Grok 2.0.MiniPerplx A minimalistic AI-powered search engine that helps you find information on the internet. ProductHunt Launch Upvote MiniPerplx on ProductHunt to show your support! Features AI-powered search: Get answers to your questions using Anthropic's Models. Web search: Search the web using Tavily's API. URL Specific search: Get informatio…
Whereabouts Ascertainment for Low-lying Detectable Objects. The SOTA in FOSS AI for drones!W.A.L.D.O. Whereabouts Ascertainment for Low-lying Detectable Objects Welcome to the WALDO v3.0 public release WHAT IS WALDO? WALDO is a detection AI model, based on a large YOLO-v8 backbone and my own synthetic data pipeline. The model is capable of detecting these classes of items in overhead imagery ranging in altitude from about 30 feet to satellite imagery! Output classes: 0 -> 'LightVehicle&…
The Enterprise-Grade Production-Ready Multi-Agent Orchestration Framework Join our Community: https://discord.com/servers/agora-999382051935506503 The Enterprise-Grade Production-Ready Multi-Agent Orchestration Framework 🐦 Twitter • 📢 Discord • Swarms Platform • 📙 Documentation ✨ Features Category Features Benefits 🏢 Enterprise Architecture • Production-Ready Infrastructure• High Reliability Systems• Modular Des…
Automagically reverse-engineer REST APIs via capturing trafficmitmproxy2swagger video.mp4 A tool for automatically converting mitmproxy captures to OpenAPI 3.0 specifications. This means that you can automatically reverse-engineer REST APIs by just running the apps and capturing the traffic. 🆕 NEW! Added support for processing HAR exported from the browser DevTools. See Usage - HAR for more details. Installation First you will need python3 and pip3. $ pi…