[Feature] Any way to get the logits instead of logprobs in lmdeploy?

[hmzo]

Motivation

I now want to use lmdeploy to deploy internlm2-7b-reward.
I simply expanded the weight in v_head from [1, D] to [V, D].
If we can directly obtain the logits instead of logprobs , then we can deploy the reward model using lmdeploy easily.

Related resources

No response

Additional context

No response

[lvhan028]

@irexyc

[irexyc]

Sorry for late reply.

Currently, you can use pipe.get_logits to obtain the logits with seq_len x vocab_size shape. It's not thread safe, I'm not sure if this meets your needs.