# I’m getting an HTTP code 524 response from the the inference API’s

## post by bnbnbn on Mar 2, 2025

Have been using the inference API’s a fair bit and more and more seem to be getting 524 status code responses. A quick google suggests this might be cloudflare response.

Is this just me and is this more common?

Edit: Should have added i’m mostly using the `llama3.3-70b-instruct-fp8` endpoint, if i try and run multiple (approx 5) concurrent queries it seems to trigger it, or at least increase the chances of it occuring. Haven’t had a chance to see if different models have the same issue.

91 views

### Related topics
| Topic | Replies | Views | Activity |
| --- | --- | --- | --- |
| [Did inference api change recently?](https://deeptalk.lambda.ai/t/did-inference-api-change-recently/4569) | [0](https://deeptalk.lambda.ai/t/did-inference-api-change-recently/4569/1) | 119 | [Mar 2025](https://deeptalk.lambda.ai/t/did-inference-api-change-recently/4569/1) |
| [Inference API Timeout](https://deeptalk.lambda.ai/t/inference-api-timeout/4643) | [2](https://deeptalk.lambda.ai/t/inference-api-timeout/4643/1) | 158 | [Jun 2025](https://deeptalk.lambda.ai/t/inference-api-timeout/4643/3) |
| [Hermes3-405B API not responding](https://deeptalk.lambda.ai/t/hermes3-405b-api-not-responding/4762) | [1](https://deeptalk.lambda.ai/t/hermes3-405b-api-not-responding/4762/1) | 239 | [Oct 2025](https://deeptalk.lambda.ai/t/hermes3-405b-api-not-responding/4762/2) |
| [Inference API call returning “HTTP/1.1 400 Bad Request”](https://deeptalk.lambda.ai/t/inference-api-call-returning-http-1-1-400-bad-request/4497) | [1](https://deeptalk.lambda.ai/t/inference-api-call-returning-http-1-1-400-bad-request/4497/1) | 131 | [Feb 2025](https://deeptalk.lambda.ai/t/inference-api-call-returning-http-1-1-400-bad-request/4497/2) |
| [Inferrence Streaming Changed](https://deeptalk.lambda.ai/t/inferrence-streaming-changed/4636) | [0](https://deeptalk.lambda.ai/t/inferrence-streaming-changed/4636/1) | 84 | [May 2025](https://deeptalk.lambda.ai/t/inferrence-streaming-changed/4636/1) |