Commit Graph
586 Commits
Author SHA1 Message Date
叁月柒andGitHub b9d319996c Add conditional check for specific repository 2025-12-31 09:34:53 +08:00
叁月柒andGitHub 53b6ebcaa9 Add GitHub Actions workflow for syncing releases 2025-12-31 09:33:13 +08:00
MarSeventh b11e34fdbf Feat:新增discord/huggingface渠道支持;优化telegram大文件上传体验 2025-12-31 09:23:38 +08:00
叁月柒andGitHub f0ba4c3c68 Merge pull request #403 from lintonxue00/main
添加 Discord/HuggingFace 渠道支持,优化 TG 分块
2025-12-31 08:43:00 +08:00
axibayuit 11be7cbe8b chore: remove HuggingFace SDK reference files (used for research only) 2025-12-30 23:57:35 +08:00
axibayuit 0495398ab6 Merge upstream/main 2025-12-30 23:43:51 +08:00
axibayuit c408fa16e3 style: keep full channel names in admin settings, abbreviations only for user upload 2025-12-30 23:04:45 +08:00
axibayuit c742c86b33 style: shorten channel labels (TG/R2/S3/DC/HF) 2025-12-30 23:00:33 +08:00
axibayuit 86f0904aa2 feat: optimize TG chunk size to 16MB (safety margin from 20MB getFile limit) 2025-12-30 22:46:30 +08:00
axibayuit 951edda63c fix(discord): lower chunk threshold to 9MB for Discord (10MB limit) 2025-12-30 22:16:14 +08:00
axibayuit 1e92c6de82 feat(discord): implement chunked upload for large files (>20MB)
- Add uploadSingleChunkToDiscord function with rate limit handling
- Add uploadChunkToDiscordWithRetry with 429 retry support
- Add mergeDiscordChunksInfo for chunk metadata assembly
- Add handleDiscordChunkedFile for streaming download
- Add fetchDiscordChunkWithRetry for reliable chunk fetching
- Discord uses 9MB chunks (vs 10MB for others) for safety margin
- Support Range requests for video seeking
- Support proxy URL for Discord CDN
2025-12-30 22:01:19 +08:00
axibayuit ff417f9091 build: update frontend with response format fix for HuggingFace direct upload 2025-12-30 21:28:41 +08:00
axibayuit 4ae6989e60 fix: pass oid to uploadMultipart for multipart complete request 2025-12-30 21:17:28 +08:00
axibayuit 94af65dcfc fix: improve HuggingFace large file upload
- Fix commitUpload missing url parameter for endUpload
- Implement incremental SHA256 hash algorithm for large files
- Use 4MB chunks for SHA256 calculation to reduce memory pressure
- Support files of any size without memory overflow
2025-12-30 21:00:18 +08:00
axibayuit f6a5fa0f9e fix: use fetchUploadConfig instead of getUploadConfig 2025-12-30 20:45:58 +08:00
axibayuit 01434ddd38 feat(huggingface): implement direct upload for large files (>20MB)
- Add frontend direct upload to HuggingFace S3, bypassing CF Workers limits
- Add /api/huggingface/getUploadUrl endpoint to get LFS upload URLs
- Add /api/huggingface/commitUpload endpoint to commit file references
- Support multipart upload for very large files
- SHA256 computed in frontend to avoid CF Workers CPU timeout
- Small files (<20MB) still use proxy upload through CF Workers
2025-12-30 20:42:38 +08:00
axibayuit b1af1a92bb feat: optimize HuggingFace upload - compute SHA256 on frontend to avoid CF Workers CPU timeout 2025-12-30 20:31:33 +08:00
axibayuit 5b85007d80 feat: implement native LFS upload protocol for HuggingFace (no external SDK) 2025-12-30 20:08:28 +08:00
axibayuit d564f81f5b fix: update HuggingFace SDK to v0.23.0 and disable Xet/WebWorkers for CF Workers compatibility 2025-12-30 20:04:25 +08:00
axibayuit 041f1888ea fix: use NDJSON format for HuggingFace commit API 2025-12-30 19:57:50 +08:00
axibayuit 088d3d78bc fix: use string fields instead of JSON blob for HuggingFace commit API 2025-12-30 19:52:36 +08:00
axibayuit c1e4442be3 fix: correct HuggingFace commit API format - header as JSON blob 2025-12-30 19:46:36 +08:00
axibayuit e0a54925db fix: use POST commit API with multipart form data for HuggingFace upload 2025-12-30 19:42:10 +08:00
axibayuit cbe352cac8 fix: simplify HuggingFace upload - direct PUT without encoding 2025-12-30 18:58:06 +08:00
axibayuit 82d03cf0b9 fix: use multipart form upload for HuggingFace to avoid CPU timeout 2025-12-30 18:48:25 +08:00
axibayuit a5251f898c fix: use direct binary upload instead of base64 to avoid CPU timeout 2025-12-30 18:44:42 +08:00
axibayuit ad8c5ac9cd fix: use correct HuggingFace commit API format with base64 encoding 2025-12-30 18:22:17 +08:00
axibayuit 9f3636e4fd debug: add detailed logging for HuggingFace upload 2025-12-30 18:09:09 +08:00
axibayuit ffd0b0d3da fix: use simple upload API for HuggingFace 2025-12-30 18:06:09 +08:00
axibayuit 2a95a975bc fix: update HuggingFace API to use LFS upload method 2025-12-30 18:05:05 +08:00
axibayuit 21a441d965 build: update frontend with HuggingFace channel UI 2025-12-30 17:52:37 +08:00
axibayuit 2df7e1ebea feat: add HuggingFace storage channel support
- Add HuggingFace API wrapper class (huggingfaceAPI.js)
- Support upload, download, delete operations via HuggingFace Hub API
- Support public repos (unlimited storage) and private repos (100GB limit)
- Private repos: server proxies requests with Authorization header
- Auto-create repo if not exists (with write token)
- Add HuggingFace to auto-retry channel list
- Environment variables: HF_TOKEN, HF_REPO, HF_PRIVATE
- Support load balancing for multiple HuggingFace channels
2025-12-30 17:46:11 +08:00
axibayuit 9ef46f45ce feat(discord): add delete message support for Discord channel 2025-12-30 15:57:17 +08:00
axibayuit e0a95c439e fix: Discord 渠道配置添加 isNitro 字段持久化支持 2025-12-30 15:44:30 +08:00
axibayuit 8a4e9f5fcb feat: Discord 渠道添加 Nitro 会员开关,支持 25MB 上传 2025-12-30 15:39:39 +08:00
axibayuit ab4fa9ee2f fix: Discord 渠道显示为 DC 而非未知 2025-12-30 15:31:51 +08:00
axibayuit 1a8a285303 feat: 添加 Discord 渠道到上传设置界面 2025-12-30 15:24:25 +08:00
axibayuit 0d31d77ea9 fix: 移除 docs 子目录的 submodule 引用 2025-12-30 15:11:02 +08:00
axibayuit 9a0ab93790 feat: 添加 Discord 渠道支持
- 新增 Discord API 封装类 (discordAPI.js)
- 支持 Discord 文件上传(10MB 限制,超过自动切换其他渠道)
- 支持 Discord 文件读取和代理 URL(国内访问)
- 前端添加 Discord 渠道配置 UI(负载均衡、表单验证)
- 支持环境变量配置:DISCORD_BOT_TOKEN, DISCORD_CHANNEL_ID, DISCORD_PROXY_URL
- 修复 sysConfig.js 中 Discord 渠道过滤
2025-12-30 15:08:19 +08:00
MarSeventh 7af35ce3fa Feat:支持R2/S3渠道容量限制 2025-12-30 12:38:28 +08:00
MarSeventh 23c687cfc2 Feat:支持R2/S3渠道容量限制 2025-12-30 12:31:11 +08:00
叁月柒andGitHub 1089dcbb40 Merge pull request #402 from lintonxue00/main
feat: 添加 R2/S3 渠道容量限制功能
2025-12-30 11:47:00 +08:00
axibayuit 02b8804ed8 fix: 前端页面加载时使用GET读取容量统计,避免每次打开都重建索引 2025-12-30 00:28:48 +08:00
axibayuit 562f9d3b5b perf: 优化容量检查,未启用时跳过KV读取 2025-12-30 00:14:56 +08:00
axibayuit ab9e3102ab fix: 移除 submodule 引用,将前端源码目录加入 gitignore 2025-12-29 23:28:08 +08:00
axibayuit fdb876673f refactor: 移除不再使用的 updateQuotaCounter 函数 2025-12-29 23:23:21 +08:00
axibayuit 5c11f477af perf: 优化容量统计,从索引元数据读取,减少 KV 写入操作 2025-12-29 23:20:04 +08:00
axibayuit 8f80ae10d0 fix: 刷新按钮改为 POST 请求重新统计容量,而不是只获取旧数据 2025-12-29 21:52:38 +08:00
axibayuit 7e3c0e1670 fix: 修复容量统计重复计算问题,使用 readIndex 统一获取文件列表并去重 2025-12-29 21:36:38 +08:00
axibayuit fb2caf54ed fix: use actual R2 file size instead of client-side size 2025-12-29 21:16:42 +08:00