Skip to content

Commit 11956af

Browse files
author
The tunix Authors
committed
Updates SGLang sampler according to their change.
PiperOrigin-RevId: 827637833
1 parent 9aa78dd commit 11956af

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

tunix/generate/sglang_jax_sampler.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -108,7 +108,7 @@ def _sglang_jax_config(self, config: SglangJaxConfig):
108108
args["model_path"] = config.model_version
109109
args["precompile_bs_paddings"] = [1, 64]
110110
args["precompile_token_paddings"] = [8192]
111-
args["disable_jax_precompile"] = True
111+
args["disable_precompile"] = True
112112
args["page_size"] = 64
113113
args["context_length"] = config.context_length
114114
args["tp_size"] = self._find_tp_size(config.mesh)

0 commit comments

Comments
 (0)