-
Notifications
You must be signed in to change notification settings - Fork 6.3k
Issues: ray-project/ray
[RFC][llm] Prefill/Decode disaggregation with Ray Serve
#53257
opened May 23, 2025 by
kouroshHakha
Open
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Author
Label
Projects
Milestones
Assignee
Sort
Issues list
Release test batch_inference_hetero failed
bug
Something that is supposed to be working; but isn't
data
Ray Data-related issues
P0
Issues that should be fixed in short order
ray-test-bot
Issues managed by OSS test policy
release-test
release test
stability
triage
Needs triage (eg: priority, bug/not-bug, and owning component)
weekly-release-blocker
Issues that will be blocking Ray weekly releases
#53601
opened Jun 6, 2025 by
can-anyscale
[Core] ray._raylet.ObjectRef and ray.types.ObjectRef type compabtibility
enhancement
Request for new feature and/or capability
triage
Needs triage (eg: priority, bug/not-bug, and owning component)
#53591
opened Jun 5, 2025 by
minerharry
[RLlib][PPO new-API] Large discrepancy between Algorithm.evaluate() and manual inference via restored EnvToModule/ModuleToEnv pipelines on CarRacing-v3
bug
Something that is supposed to be working; but isn't
triage
Needs triage (eg: priority, bug/not-bug, and owning component)
#53588
opened Jun 5, 2025 by
lukaskiss222
[Serve] Autoscaling not working correctly when Something that is supposed to be working; but isn't
triage
Needs triage (eg: priority, bug/not-bug, and owning component)
max_replica_per_node
is set in Ray Serve
bug
#53582
opened Jun 5, 2025 by
antoniopatrizio
[Ray Train Feature Request] Native Cross-Validation Support in Ray Train API
enhancement
Request for new feature and/or capability
triage
Needs triage (eg: priority, bug/not-bug, and owning component)
#53581
opened Jun 5, 2025 by
shoaibkhanz
[Serve] Unable to load meta-llama/Llama-3.3-70B-Instruct
bug
Something that is supposed to be working; but isn't
triage
Needs triage (eg: priority, bug/not-bug, and owning component)
#53571
opened Jun 4, 2025 by
grumpydude
[core] TPU Visible Chips not set correctly
bug
Something that is supposed to be working; but isn't
triage
Needs triage (eg: priority, bug/not-bug, and owning component)
#53569
opened Jun 4, 2025 by
BabyChouSr
[Data] Add support for streaming version of Request for new feature and/or capability
P2
Important issue, but not time-critical
repartition(key=...)
enhancement
#53560
opened Jun 4, 2025 by
alexeykudinkin
[RayData] The write operator supports the use of an actor pool
enhancement
Request for new feature and/or capability
triage
Needs triage (eg: priority, bug/not-bug, and owning component)
#53552
opened Jun 4, 2025 by
MissiontoMars
Release test sort_autoscaling failed
bug
Something that is supposed to be working; but isn't
data
Ray Data-related issues
jailed-test
Indicate that this test is jailed and will stop running in CI/CD
P0
Issues that should be fixed in short order
ray-test-bot
Issues managed by OSS test policy
release-test
release test
stability
triage
Needs triage (eg: priority, bug/not-bug, and owning component)
unstable-release-test
#53546
opened Jun 4, 2025 by
can-anyscale
Error Handling Large Pyarrow Chunk
bug
Something that is supposed to be working; but isn't
triage
Needs triage (eg: priority, bug/not-bug, and owning component)
#53536
opened Jun 3, 2025 by
ranandfigma
[Serve][llm] Make Serve LLM endpoint 100% compatible with the engine's native server.
enhancement
Request for new feature and/or capability
llm
#53533
opened Jun 3, 2025 by
kouroshHakha
[RLlib] Is IMPALA applicable to continuous action spaces?
docs
An issue or change related to documentation
triage
Needs triage (eg: priority, bug/not-bug, and owning component)
#53521
opened Jun 3, 2025 by
jn12-29
[core] ray.init() not possible even while on same network as Ray Cluster.
bug
Something that is supposed to be working; but isn't
core
Issues that should be addressed in Ray Core
docs
An issue or change related to documentation
stability
triage
Needs triage (eg: priority, bug/not-bug, and owning component)
usability
#53520
opened Jun 3, 2025 by
kryanbeane
[CI][Tune] Enable isort for Tune-related issues
python/ray/tune/__init__.py
and fix circular imports
tune
#53518
opened Jun 3, 2025 by
MortalHappiness
[Ray Data] Filtering function is very slow
bug
Something that is supposed to be working; but isn't
data
Ray Data-related issues
@external-author-action-required
Alternate tag for PRs where the author doesn't have labeling permission.
performance
#53493
opened Jun 2, 2025 by
BabyChouSr
[Serve.llm] Clean up output logs and give option to opt out of different verbosity levels
bug
Something that is supposed to be working; but isn't
llm
#53492
opened Jun 2, 2025 by
kouroshHakha
[core|serve] Migrate shared utilities from Great starter issue for someone just starting to contribute to Ray
ray._private
to ray._common
good-first-issue
#53478
opened Jun 2, 2025 by
abrarsheikh
[RLlib] Headnode without GPU triggers torch/CUDA de-serialization error
bug
Something that is supposed to be working; but isn't
P1
Issue that should be fixed within a few weeks
rllib
RLlib related issues
#53467
opened Jun 1, 2025 by
ArturNiederfahrenhorst
[Data] dataset.write_iceberg to support upserts
data
Ray Data-related issues
enhancement
Request for new feature and/or capability
P2
Important issue, but not time-critical
usability
#53438
opened May 30, 2025 by
gero90
Previous Next
ProTip!
Follow long discussions with comments:>50.