Skip to content

Pull requests: mlcommons/endpoints

Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort

Pull requests list

document output folder structure size/normal PR Review Policy: <=500 non-test lines & <=20 files
#498 opened Sep 9, 2026 by anandhu-eng Contributor Loading…
feat(swe-bench): add persistent Pyxis runtime size/very-large PR Review Policy: >1500 lines or >50 files
#496 opened Sep 5, 2026 by leopck Collaborator Loading…
docs: add DSV4 agentic benchmark + ARM64 SWE-bench builder + Approved artifacts list size/normal PR Review Policy: <=500 non-test lines & <=20 files
#494 opened Sep 4, 2026 by hvagadia Collaborator Loading…
feat(metrics): report E2E average interactivity size/normal PR Review Policy: <=500 non-test lines & <=20 files
#493 opened Sep 3, 2026 by hvagadia Collaborator Loading…
feat(provenance): resolve source git SHA via a validated multi-channel chain size/normal PR Review Policy: <=500 non-test lines & <=20 files
#491 opened Sep 1, 2026 by arekay-nv Collaborator Draft
feat(report): add events.jsonl SHA-256 to result_summary.json size/normal PR Review Policy: <=500 non-test lines & <=20 files
#490 opened Aug 31, 2026 by arekay-nv Collaborator Loading…
feat(agentic): auto-download official dataset size/normal PR Review Policy: <=500 non-test lines & <=20 files
#489 opened Aug 27, 2026 by tianmu-li Collaborator Loading…
7 of 10 tasks
feat(swe-bench): add the distributed fleet scorer size/large PR Review Policy: 501-1500 lines or 21-50 files
#485 opened Aug 27, 2026 by leopck Collaborator 6/6 Loading…
feat(swe-bench): gate dispatch on endpoint readiness size/large PR Review Policy: 501-1500 lines or 21-50 files
#484 opened Aug 27, 2026 by leopck Collaborator 5/6 Loading…
feat(swe-bench): classify evaluation infrastructure failures size/normal PR Review Policy: <=500 non-test lines & <=20 files
#483 opened Aug 27, 2026 by leopck Collaborator 4/6 Loading…
feat(swe-bench): recover conservatively from infrastructure failures size/large PR Review Policy: 501-1500 lines or 21-50 files
#482 opened Aug 27, 2026 by leopck Collaborator 3/6 Loading…
feat(swe-bench): enforce run-scoped all-or-nothing merging size/normal PR Review Policy: <=500 non-test lines & <=20 files
#481 opened Aug 27, 2026 by leopck Collaborator 2/6 Loading…
feat(swe-bench): add a durable distributed work queue size/large PR Review Policy: 501-1500 lines or 21-50 files
#480 opened Aug 27, 2026 by leopck Collaborator 1/6 Loading…
[docs] Benchmark suite and ruleset proposal size/normal PR Review Policy: <=500 non-test lines & <=20 files
#468 opened Aug 25, 2026 by arekay-nv Collaborator Loading…
10 tasks
fix(swebench-service): give Pyxis container creation its own deadline size/normal PR Review Policy: <=500 non-test lines & <=20 files
#456 opened Aug 19, 2026 by leopck Collaborator Loading…
10 tasks
fix(benchmark): an accuracy run that produces no number must fail size/normal PR Review Policy: <=500 non-test lines & <=20 files
#454 opened Aug 19, 2026 by leopck Collaborator Loading…
1 of 4 tasks
fix(benchmark): don't reject an accuracy-only run for listing many endpoints size/normal PR Review Policy: <=500 non-test lines & <=20 files
#453 opened Aug 19, 2026 by leopck Collaborator Loading…
1 of 4 tasks
docs: steady-state metrics reporting design proposal size/very-large PR Review Policy: >1500 lines or >50 files
#447 opened Aug 13, 2026 by nv-alicheng Collaborator Loading…
2 of 10 tasks
Added Conversational Aware Routing for Dynamo support
#434 opened Jul 30, 2026 by leopck Collaborator Draft
Add License Scanning and Reporting for Endpoints Changes on Main.
#412 opened Jul 14, 2026 by arav-agarwal2 Collaborator Loading…
4 of 10 tasks
feat :Testing workflow to push images size/large PR Review Policy: 501-1500 lines or 21-50 files
#405 opened Jul 9, 2026 by arekay-nv Collaborator Loading…
10 tasks
fix(endpoint-client): retry pre-response connection resets (opt-in)
#404 opened Jul 8, 2026 by Palanivelg Contributor Loading…
3 tasks done
DRAFT: feat(power): vendor-agnostic power/energy monitoring
#383 opened Jun 30, 2026 by viraatc Collaborator Loading…
feat: add configurable live metrics publishing for CPU servers
#363 opened Jun 22, 2026 by attafosu Collaborator Loading…
10 tasks
DeepSeek-V4-Pro benchmarking example (vLLM + SGLang)
#347 opened Jun 8, 2026 by karverma-amd Loading…
3 tasks
ProTip! What’s not been updated in a month: updated:<2026-08-09.