On-device AI across mobile, embedded and edge for PyTorchExecuTorch ExecuTorch is an end-to-end solution for enabling on-device inference capabilities across mobile and edge devices including wearables, embedded devices and microcontrollers. It is part of the PyTorch Edge ecosystem and enables efficient deployment of PyTorch models to edge devices. Key value propositions of ExecuTorch are: Portability: Compatibility with a wide variety of computing platforms, from high-end mobile phones to hig…
An efficient, flexible and full-featured toolkit for fine-tuning large models (InternLM, Llama, Baichuan, Qwen, ChatGLM) 👋 join us on 🔍 Explore our models on English | 简体中文 🎉 News [2024/04] Latest VLM LLaVA-Llama-3-8B and LLaVA-Llama-3-8B-v1.1 are released! Click here for details! [2024/04] Support Llama 3 models! [2024/04] Support Sequence Parallel for enabling highly efficient and scalable LLM training with extremely long sequence lengths! [Usage] [Speed Benchmark] [2024/…
A GUI Panel providing Worker subscriptions and Fragment settings and configs, providing configs for cross-platform clients using (singbox-core and xray-core)💦 BPB Panel 🌏 Readme in Farsi Introduction This project is dedicated to developing a user panel for the Cloudflare-workers/pages proxy script created by yonggekkk. The panel offers two deployment options: Worker deployment Pages deployment 🌟 If you found BPB Panel valuable, Your donations make all the difference 🌟 USDT (TRC20): TU…
Turn any webpage into structured data using LLMsLLM Scraper LLM Scraper is a TypeScript library that allows you to convert any webpages into structured data using LLMs. TipUnder the hood, it uses function calling to convert pages to structured data. You can find more about this approach here Features Supports Local (GGUF), OpenAI, Groq chat models Schemas defined with Zod Full type-safety with TypeScript Based on Playwright framework Streaming when crawling multiple pages Supports 4 input mo…
Llama3 中文仓库（聚合资料：各种网友及厂商微调、魔改版本有趣权重 & 训练、推理、部署教程视频 & 文档）llama3-Chinese-chat first version of llama3 in Chinese (首个llama3 中文版) ，本仓库供交流llama3中文相关学习内容，欢迎任何人加入共建PR 新增网页部署：点此查看 如果你有自己微调的版本或者在网上发现有趣的特化版本，欢迎提issue收录。 更新记录 2024-04-19 下午1点：世界上首个llama3 中文版训练完成，晚上没睡觉哈哈，使用170k+高质量多轮中文对话数据连夜训练得到。 2024-04-20 早上7点：v2版训练完成 2023-04-20 晚上23点：instruct 中文版训练完成 2024-04-21 晚上2点：增加训练教程、推理教程、网页部署等文档整理 近期todo：录制b站视频、封装云端训练镜像、放出量化后gguf、ollama版本及教程 近期（预计一个半月后）还会开源一个浏览器插件，AI笔记功能+AI思维导图功能，在跟同学一起用闲时开发（他们俩是主力哈哈），…
User-friendly WebUI for LLMs (Formerly Ollama WebUI)Open WebUI (Formerly Ollama WebUI) 👋 Open WebUI is an extensible, feature-rich, and user-friendly self-hosted WebUI designed to operate entirely offline. It supports various LLM runners, including Ollama and OpenAI-compatible APIs. For more information, be sure to check out our Open WebUI Documentation. Features ⭐ 🖥️ Intuitive Interface: Our chat interface takes inspiration from ChatGPT, ensuring a user-friendly experience. 📱 Re…
Llama中文社区，最好的中文Llama大模型，完全开源可商用 English ｜ 中文 Llama中文社区 最好的中文Llama大模型 🤗 Hugging Face • 🤖 ModelScope • ✡️ WiseModel Llama3 在线体验（包含Llama2）：https://llama.family 基于Llama2的开源中文预训练大模型Atom-7B 🗂️ 目录 📌 Llama中文社区 🔥 社区介绍：Llama中文社区 📢 最新动态 🤗 模型 🤗 中文预训练模型Atom-7B 🤗 Llama3官方模型 🤗 Llama2官方模型 🤗 Llama2中文微调模型 🌟 社区资源 📌 如何使用Llama模型? 快速上手-使用Anaconda 快速上手-使用Docker 快速上手-使用llama.cpp 快速上手-使用gradio 快速上手-构建API服务 🤖 模型预训练 💡 模型微调 Step1: 环境准备 Step2: 数据准备 Step3: 微调脚本 LoRA微调 全量参数微…