{"payload":{"feedbackUrl":"https://github.com/orgs/community/discussions/53140","repo":{"id":634081686,"defaultBranch":"main","name":"mlc-llm","ownerLogin":"mlc-ai","currentUserCanPush":false,"isFork":false,"isEmpty":false,"createdAt":"2023-04-29T01:59:25.000Z","ownerAvatar":"https://avatars.githubusercontent.com/u/106173866?v=4","public":true,"private":false,"isOrgOwned":true},"refInfo":{"name":"","listCacheKey":"v0:1727531104.0","currentOid":""},"activityList":{"items":[{"before":"3f70663d239bb5a79f4805608afc66926692314c","after":"92c4a259f86fcac06d67a23ca387a77097196dcd","ref":"refs/heads/gh-pages","pushedAt":"2024-09-28T14:04:31.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"github-actions[bot]","name":null,"path":"/apps/github-actions","primaryAvatarUrl":"https://avatars.githubusercontent.com/in/15368?s=80&v=4"},"commit":{"message":"Build at Sat Sep 28 14:04:31 UTC 2024","shortMessageHtmlLink":"Build at Sat Sep 28 14:04:31 UTC 2024"}},{"before":"a1363f1cac6cc71e6c3392e483285d55eab1aa3d","after":"d1ebaa552272b1995e6d79219a2d01e4d0393bcc","ref":"refs/heads/main","pushedAt":"2024-09-28T13:58:06.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"MasterJH5574","name":"Ruihang Lai","path":"/MasterJH5574","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/45167100?s=80&v=4"},"commit":{"message":"[Python] Update dependency for benchmark (#2951)\n\nThis PR updates the python package dependency that is required \r\nby when running `mlc_llm.bench`.","shortMessageHtmlLink":"[Python] Update dependency for benchmark (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2554235468\" data-permission-text=\"Title is private\" data-url=\"https://github.com/mlc-ai/mlc-llm/issues/2951\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/mlc-ai/mlc-llm/pull/2951/hovercard\" href=\"https://github.com/mlc-ai/mlc-llm/pull/2951\">#2951</a>)"}},{"before":"ae2b2be2b972889f526726b128d5b5e3ba36096a","after":"3f70663d239bb5a79f4805608afc66926692314c","ref":"refs/heads/gh-pages","pushedAt":"2024-09-28T13:52:24.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"github-actions[bot]","name":null,"path":"/apps/github-actions","primaryAvatarUrl":"https://avatars.githubusercontent.com/in/15368?s=80&v=4"},"commit":{"message":"Build at Sat Sep 28 13:52:24 UTC 2024","shortMessageHtmlLink":"Build at Sat Sep 28 13:52:24 UTC 2024"}},{"before":"d89016c43d38a53157234274bfd2a2b7efec8193","after":"a1363f1cac6cc71e6c3392e483285d55eab1aa3d","ref":"refs/heads/main","pushedAt":"2024-09-28T13:45:21.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"MasterJH5574","name":"Ruihang Lai","path":"/MasterJH5574","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/45167100?s=80&v=4"},"commit":{"message":"[CI] Update docker image (#2950)\n\nThis PR updates the docker image for CI.","shortMessageHtmlLink":"[CI] Update docker image (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2553958139\" data-permission-text=\"Title is private\" data-url=\"https://github.com/mlc-ai/mlc-llm/issues/2950\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/mlc-ai/mlc-llm/pull/2950/hovercard\" href=\"https://github.com/mlc-ai/mlc-llm/pull/2950\">#2950</a>)"}},{"before":null,"after":"5ea4bc48be647201b6b209973c371e24376ec950","ref":"refs/heads/py-dependency","pushedAt":"2024-09-28T13:45:04.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"MasterJH5574","name":"Ruihang Lai","path":"/MasterJH5574","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/45167100?s=80&v=4"},"commit":{"message":"[Python] Update dependency for benchmark\n\nThis PR updates the python package dependency that is required \r\nby when running `mlc_llm.bench`.","shortMessageHtmlLink":"[Python] Update dependency for benchmark"}},{"before":null,"after":"656ce109121a191bc5dd9158b5407003eec66121","ref":"refs/heads/ci-docker-image","pushedAt":"2024-09-28T02:24:40.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"MasterJH5574","name":"Ruihang Lai","path":"/MasterJH5574","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/45167100?s=80&v=4"},"commit":{"message":"[CI] Update docker image\n\nThis PR updates the docker image for CI.","shortMessageHtmlLink":"[CI] Update docker image"}},{"before":"62044a356222bafad8752807d31ef53987e1115e","after":null,"ref":"refs/heads/CharlieFRuan-patch-1","pushedAt":"2024-09-28T02:23:39.000Z","pushType":"branch_deletion","commitsCount":0,"pusher":{"login":"MasterJH5574","name":"Ruihang Lai","path":"/MasterJH5574","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/45167100?s=80&v=4"}},{"before":"7f56eb512d95cc7a8e1f305cc341e540f0c10d9b","after":"ae2b2be2b972889f526726b128d5b5e3ba36096a","ref":"refs/heads/gh-pages","pushedAt":"2024-09-28T02:04:24.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"github-actions[bot]","name":null,"path":"/apps/github-actions","primaryAvatarUrl":"https://avatars.githubusercontent.com/in/15368?s=80&v=4"},"commit":{"message":"Build at Sat Sep 28 02:04:24 UTC 2024","shortMessageHtmlLink":"Build at Sat Sep 28 02:04:24 UTC 2024"}},{"before":"d77a1f42263eecdb759e31a5a8c1fc90eb9e845f","after":"d89016c43d38a53157234274bfd2a2b7efec8193","ref":"refs/heads/main","pushedAt":"2024-09-28T01:57:44.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"tqchen","name":"Tianqi Chen","path":"/tqchen","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/2577440?s=80&v=4"},"commit":{"message":"[CUTLASS] Add FP8 gemm kernels (#2936)\n\nThis PR introduces the CUTLASS FP8 gemm kernels for sm_90a for better\nperformance over cuBLAS.","shortMessageHtmlLink":"[CUTLASS] Add FP8 gemm kernels (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2543631918\" data-permission-text=\"Title is private\" data-url=\"https://github.com/mlc-ai/mlc-llm/issues/2936\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/mlc-ai/mlc-llm/pull/2936/hovercard\" href=\"https://github.com/mlc-ai/mlc-llm/pull/2936\">#2936</a>)"}},{"before":"8eefe755ad231d9c31eba6800d9e6e8ff810413c","after":"7f56eb512d95cc7a8e1f305cc341e540f0c10d9b","ref":"refs/heads/gh-pages","pushedAt":"2024-09-28T01:37:20.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"github-actions[bot]","name":null,"path":"/apps/github-actions","primaryAvatarUrl":"https://avatars.githubusercontent.com/in/15368?s=80&v=4"},"commit":{"message":"Build at Sat Sep 28 01:37:19 UTC 2024","shortMessageHtmlLink":"Build at Sat Sep 28 01:37:19 UTC 2024"}},{"before":"fba9990cb5f67f5737c5595edbe68f80f612559a","after":"d77a1f42263eecdb759e31a5a8c1fc90eb9e845f","ref":"refs/heads/main","pushedAt":"2024-09-28T01:30:15.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"MasterJH5574","name":"Ruihang Lai","path":"/MasterJH5574","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/45167100?s=80&v=4"},"commit":{"message":"[Fix] Fix draft token indices in eagle drafting (#2949)","shortMessageHtmlLink":"[Fix] Fix draft token indices in eagle drafting (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2553861971\" data-permission-text=\"Title is private\" data-url=\"https://github.com/mlc-ai/mlc-llm/issues/2949\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/mlc-ai/mlc-llm/pull/2949/hovercard\" href=\"https://github.com/mlc-ai/mlc-llm/pull/2949\">#2949</a>)"}},{"before":"d8d839bf1c441f2b3504074b12d3b0e73f7b9a3f","after":"8eefe755ad231d9c31eba6800d9e6e8ff810413c","ref":"refs/heads/gh-pages","pushedAt":"2024-09-28T01:01:07.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"github-actions[bot]","name":null,"path":"/apps/github-actions","primaryAvatarUrl":"https://avatars.githubusercontent.com/in/15368?s=80&v=4"},"commit":{"message":"Build at Sat Sep 28 01:01:06 UTC 2024","shortMessageHtmlLink":"Build at Sat Sep 28 01:01:06 UTC 2024"}},{"before":"2d5f21f406a9023ded29d8f5f7f8c6000a7b4f1f","after":"fba9990cb5f67f5737c5595edbe68f80f612559a","ref":"refs/heads/main","pushedAt":"2024-09-28T00:54:18.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"MasterJH5574","name":"Ruihang Lai","path":"/MasterJH5574","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/45167100?s=80&v=4"},"commit":{"message":"[Conv] Remove custom from gen_config CONV_TEMPLATES (#2948)\n\n`\"custom\"` is added earlier for WebLLM, and it is no longer needed.\r\nCurrently specifying as `\"custom\"` runs into error.","shortMessageHtmlLink":"[Conv] Remove custom from gen_config CONV_TEMPLATES (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2553860203\" data-permission-text=\"Title is private\" data-url=\"https://github.com/mlc-ai/mlc-llm/issues/2948\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/mlc-ai/mlc-llm/pull/2948/hovercard\" href=\"https://github.com/mlc-ai/mlc-llm/pull/2948\">#2948</a>)"}},{"before":null,"after":"62044a356222bafad8752807d31ef53987e1115e","ref":"refs/heads/CharlieFRuan-patch-1","pushedAt":"2024-09-27T23:06:27.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"CharlieFRuan","name":"Charlie Ruan","path":"/CharlieFRuan","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/53290280?s=80&v=4"},"commit":{"message":"[Conv] Remove custom from gen_config CONV_TEMPLATES","shortMessageHtmlLink":"[Conv] Remove custom from gen_config CONV_TEMPLATES"}},{"before":"0451c6e5b8ce01ed83af295f3ffcdfef7b4164b9","after":"d8d839bf1c441f2b3504074b12d3b0e73f7b9a3f","ref":"refs/heads/gh-pages","pushedAt":"2024-09-27T20:35:32.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"github-actions[bot]","name":null,"path":"/apps/github-actions","primaryAvatarUrl":"https://avatars.githubusercontent.com/in/15368?s=80&v=4"},"commit":{"message":"Build at Fri Sep 27 20:35:31 UTC 2024","shortMessageHtmlLink":"Build at Fri Sep 27 20:35:31 UTC 2024"}},{"before":"fe79e9accbb73c2c2bf2a8028886796c2c25355e","after":"2d5f21f406a9023ded29d8f5f7f8c6000a7b4f1f","ref":"refs/heads/main","pushedAt":"2024-09-27T20:28:31.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"tqchen","name":"Tianqi Chen","path":"/tqchen","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/2577440?s=80&v=4"},"commit":{"message":"[Bench] Fix the dataset truncation (#2946)\n\nThis PR fixes the benchmark dataset processing. We used\r\n`tokenizer.model_max_length` as the length of truncation, but for some\r\ntokenizers (e.g., Llama3), the value of `model_max_length` is an\r\ninfinitely large integer, which causes error in the truncation.\r\n\r\nThis PR fixes it by setting an internal maximum limit of 100k.","shortMessageHtmlLink":"[Bench] Fix the dataset truncation (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2553015243\" data-permission-text=\"Title is private\" data-url=\"https://github.com/mlc-ai/mlc-llm/issues/2946\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/mlc-ai/mlc-llm/pull/2946/hovercard\" href=\"https://github.com/mlc-ai/mlc-llm/pull/2946\">#2946</a>)"}},{"before":"d1375ffcbb8a334f0d80aee1aeb8c665a90c2b03","after":"0451c6e5b8ce01ed83af295f3ffcdfef7b4164b9","ref":"refs/heads/gh-pages","pushedAt":"2024-09-27T13:36:12.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"github-actions[bot]","name":null,"path":"/apps/github-actions","primaryAvatarUrl":"https://avatars.githubusercontent.com/in/15368?s=80&v=4"},"commit":{"message":"Build at Fri Sep 27 13:36:11 UTC 2024","shortMessageHtmlLink":"Build at Fri Sep 27 13:36:11 UTC 2024"}},{"before":"268d52aecb1306dfc238e9167e9cd82a84b52b3e","after":"fe79e9accbb73c2c2bf2a8028886796c2c25355e","ref":"refs/heads/main","pushedAt":"2024-09-27T13:29:41.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"MasterJH5574","name":"Ruihang Lai","path":"/MasterJH5574","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/45167100?s=80&v=4"},"commit":{"message":"[Fix] Repetition penalty calculation fix (#2937)\n\nRepetition penalty compilation fix.","shortMessageHtmlLink":"[Fix] Repetition penalty calculation fix (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2544672786\" data-permission-text=\"Title is private\" data-url=\"https://github.com/mlc-ai/mlc-llm/issues/2937\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/mlc-ai/mlc-llm/pull/2937/hovercard\" href=\"https://github.com/mlc-ai/mlc-llm/pull/2937\">#2937</a>)"}},{"before":"4077d0b8c4372fd845d03c5cafac511a1b2b9db3","after":"d1375ffcbb8a334f0d80aee1aeb8c665a90c2b03","ref":"refs/heads/gh-pages","pushedAt":"2024-09-27T13:21:00.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"github-actions[bot]","name":null,"path":"/apps/github-actions","primaryAvatarUrl":"https://avatars.githubusercontent.com/in/15368?s=80&v=4"},"commit":{"message":"Build at Fri Sep 27 13:20:59 UTC 2024","shortMessageHtmlLink":"Build at Fri Sep 27 13:20:59 UTC 2024"}},{"before":"95085bdf31b5cc02c97ac14d7301863cbcd36c57","after":"268d52aecb1306dfc238e9167e9cd82a84b52b3e","ref":"refs/heads/main","pushedAt":"2024-09-27T13:14:25.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"MasterJH5574","name":"Ruihang Lai","path":"/MasterJH5574","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/45167100?s=80&v=4"},"commit":{"message":"[Fix] Deepcopy reqeust when sampling dataset (#2945)\n\nThis PR fixes the sampling of dataset in benchmark.\r\nOtherwise the sampled requests may refer to the same object\r\nand cause issues.","shortMessageHtmlLink":"[Fix] Deepcopy reqeust when sampling dataset (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2552001683\" data-permission-text=\"Title is private\" data-url=\"https://github.com/mlc-ai/mlc-llm/issues/2945\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/mlc-ai/mlc-llm/pull/2945/hovercard\" href=\"https://github.com/mlc-ai/mlc-llm/pull/2945\">#2945</a>)"}},{"before":"7561c96d491d7a73e3eaf951807b519e8dc20cf2","after":"95085bdf31b5cc02c97ac14d7301863cbcd36c57","ref":"refs/heads/main","pushedAt":"2024-09-27T05:09:37.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"github-actions[bot]","name":null,"path":"/apps/github-actions","primaryAvatarUrl":"https://avatars.githubusercontent.com/in/15368?s=80&v=4"},"commit":{"message":"Auto updated submodule references","shortMessageHtmlLink":"Auto updated submodule references"}},{"before":"bae78e8b40856df12f8d77f1e85eeb2c885936b8","after":"4077d0b8c4372fd845d03c5cafac511a1b2b9db3","ref":"refs/heads/gh-pages","pushedAt":"2024-09-26T05:11:30.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"github-actions[bot]","name":null,"path":"/apps/github-actions","primaryAvatarUrl":"https://avatars.githubusercontent.com/in/15368?s=80&v=4"},"commit":{"message":"Build at Thu Sep 26 05:11:29 UTC 2024","shortMessageHtmlLink":"Build at Thu Sep 26 05:11:29 UTC 2024"}},{"before":"0d4cf7e71f7e24ba0504de94a0972f80e06075ea","after":"7561c96d491d7a73e3eaf951807b519e8dc20cf2","ref":"refs/heads/main","pushedAt":"2024-09-26T05:04:22.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"mengshyu","name":"Mengshiun Yu","path":"/mengshyu","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/164936748?s=80&v=4"},"commit":{"message":"[Android] Update Andorid APK (#2944)\n\n* Llama-3.1-8B-Instruct-q3f16_1 -> Llama-3.2-3B-Instruct-q4f16_0\r\n* Qwen2-1.5B -> Qwen2.5-1.5B\r\n* Phi-3.5-mini q4f16_1 -> q4f16_0","shortMessageHtmlLink":"[Android] Update Andorid APK (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2549503933\" data-permission-text=\"Title is private\" data-url=\"https://github.com/mlc-ai/mlc-llm/issues/2944\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/mlc-ai/mlc-llm/pull/2944/hovercard\" href=\"https://github.com/mlc-ai/mlc-llm/pull/2944\">#2944</a>)"}},{"before":"d6efe956a4a8d302199dc6b87b3d427e977a914e","after":"bae78e8b40856df12f8d77f1e85eeb2c885936b8","ref":"refs/heads/gh-pages","pushedAt":"2024-09-26T03:09:43.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"github-actions[bot]","name":null,"path":"/apps/github-actions","primaryAvatarUrl":"https://avatars.githubusercontent.com/in/15368?s=80&v=4"},"commit":{"message":"Build at Thu Sep 26 03:09:42 UTC 2024","shortMessageHtmlLink":"Build at Thu Sep 26 03:09:42 UTC 2024"}},{"before":"32087e8301775f62dcd198540b4862fbac6e79c0","after":"0d4cf7e71f7e24ba0504de94a0972f80e06075ea","ref":"refs/heads/main","pushedAt":"2024-09-26T03:02:50.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"tqchen","name":"Tianqi Chen","path":"/tqchen","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/2577440?s=80&v=4"},"commit":{"message":"Update llama 3.2 for mobile (#2943)\n\nUpdate ios bundle build","shortMessageHtmlLink":"Update llama 3.2 for mobile (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2549397391\" data-permission-text=\"Title is private\" data-url=\"https://github.com/mlc-ai/mlc-llm/issues/2943\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/mlc-ai/mlc-llm/pull/2943/hovercard\" href=\"https://github.com/mlc-ai/mlc-llm/pull/2943\">#2943</a>)"}},{"before":"4d6f212c420ce1c1c6ae55ce9a15a129ce96987f","after":"d6efe956a4a8d302199dc6b87b3d427e977a914e","ref":"refs/heads/gh-pages","pushedAt":"2024-09-26T02:03:01.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"github-actions[bot]","name":null,"path":"/apps/github-actions","primaryAvatarUrl":"https://avatars.githubusercontent.com/in/15368?s=80&v=4"},"commit":{"message":"Build at Thu Sep 26 02:03:00 UTC 2024","shortMessageHtmlLink":"Build at Thu Sep 26 02:03:00 UTC 2024"}},{"before":"0ed2179b66fcfaef5212f8e06eb35add9f396072","after":"32087e8301775f62dcd198540b4862fbac6e79c0","ref":"refs/heads/main","pushedAt":"2024-09-26T01:56:37.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"tqchen","name":"Tianqi Chen","path":"/tqchen","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/2577440?s=80&v=4"},"commit":{"message":"[Preset] Add Llama3.2 1B 3B to model preset (#2942)","shortMessageHtmlLink":"[Preset] Add Llama3.2 1B 3B to model preset (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2549174461\" data-permission-text=\"Title is private\" data-url=\"https://github.com/mlc-ai/mlc-llm/issues/2942\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/mlc-ai/mlc-llm/pull/2942/hovercard\" href=\"https://github.com/mlc-ai/mlc-llm/pull/2942\">#2942</a>)"}},{"before":"6b2af578ae9f0f79be56f4efbdfdd011d9cdaccc","after":"4d6f212c420ce1c1c6ae55ce9a15a129ce96987f","ref":"refs/heads/gh-pages","pushedAt":"2024-09-25T09:19:15.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"github-actions[bot]","name":null,"path":"/apps/github-actions","primaryAvatarUrl":"https://avatars.githubusercontent.com/in/15368?s=80&v=4"},"commit":{"message":"Build at Wed Sep 25 09:19:14 UTC 2024","shortMessageHtmlLink":"Build at Wed Sep 25 09:19:14 UTC 2024"}},{"before":"9336b4a3451a3b714bd7613dc6641a7ff873109e","after":"0ed2179b66fcfaef5212f8e06eb35add9f396072","ref":"refs/heads/main","pushedAt":"2024-09-25T09:11:31.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"tqchen","name":"Tianqi Chen","path":"/tqchen","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/2577440?s=80&v=4"},"commit":{"message":"[Fix][Spec] Fix incorrect top-p normalization in batch verification (#2940)\n\nThis PR fixes a critical bug which does not properly set the top-p\nvalue for the probabilities computed by the main model in batch\nverification. This bug leads to a huge decrease of the speculative\ndecoding accuracy.","shortMessageHtmlLink":"[Fix][Spec] Fix incorrect top-p normalization in batch verification (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2546841791\" data-permission-text=\"Title is private\" data-url=\"https://github.com/mlc-ai/mlc-llm/issues/2940\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/mlc-ai/mlc-llm/pull/2940/hovercard\" href=\"https://github.com/mlc-ai/mlc-llm/pull/2940\">#…</a>"}},{"before":"5c425c06b5e652a33126f36e683590920e49374e","after":"6b2af578ae9f0f79be56f4efbdfdd011d9cdaccc","ref":"refs/heads/gh-pages","pushedAt":"2024-09-25T02:28:22.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"github-actions[bot]","name":null,"path":"/apps/github-actions","primaryAvatarUrl":"https://avatars.githubusercontent.com/in/15368?s=80&v=4"},"commit":{"message":"Build at Wed Sep 25 02:28:21 UTC 2024","shortMessageHtmlLink":"Build at Wed Sep 25 02:28:21 UTC 2024"}}],"hasNextPage":true,"hasPreviousPage":false,"activityType":"all","actor":null,"timePeriod":"all","sort":"DESC","perPage":30,"startCursor":"Y3Vyc29yOnYyOpK7MjAyNC0wOS0yOFQxNDowNDozMS4wMDAwMDBazwAAAATDY8Zo","endCursor":"Y3Vyc29yOnYyOpK7MjAyNC0wOS0yNVQwMjoyODoyMi4wMDAwMDBazwAAAAS_za5E"}},"title":"Activity · mlc-ai/mlc-llm"}