Logprobs Support - DeepTalk - Deep Learning Community

Logprobs Support

post by boazlavon on May 5, 2025

Hi,

Does lambda inference api support logprobs?

Like top5

Thanks

Boaz

56 views

Related topics

Topic	Replies	Views	Activity
Tool calling in Lambda Inference API Technical Help	6	361	Jun 2025
Does Inference API support batch/asynchronous processing	1	137	Mar 2025
[request] please add deepseek to lambda inference	2	238	Apr 2025
Model and content limit	2	171	Feb 2025
Did inference api change recently? Technical Help	0	117	Mar 2025