Input prompt length cannot exceed 64936 characters or 16384 tokens while using AI Builder create text with GPT using a prompt.

[Vinod_M]

Hi,
We are trying to summarize the text using AI builder (create text with GPT using a prompt). While testing, we are getting an error saying that "length cannot exceed 64936 characters or 16384 tokens". is there any other way we can increase length of characters.

Error Screenshot:

Thanks!

[samiak]

Hi @Vinod_M,

This is a limitation of the GPT 3.5 Turbo model.

You will find more details here: What's new in Azure OpenAI Service? - Azure AI services | Microsoft Learn

Hope that helps!

Samia

[vp007]

@Vinod_M @samiak  Is there any solution for this? How to break it down in the ChatGPT action?  My input is of unknown size due to N number of files. Kindly suggest if you have any idea

[Antrod]

Hi @vp007 , @Vinod_M ,

Unfortunately, it's not possible to augment the limit as this is a limitation from the GPT 3.5 service. What you can do is split your initial text into couple of pieces, summarize each piece and aggregate summaries (or summarize once again the aggregation of summaries).

[vp007]

@Antrod  Thanks for the response, I tried it. But my use case needs exact information so summarize is not going to help sadly.

Do you have any idea how to Add content to chatGpt prompt one by one of the big text. I tried to break but I did not find any TextBreak based on length in PowerAutomate 

[AlexAguirreF]

Hello!

Someone knows whats happens with that problem? Where o what is the trick?

I know that all models have a tokens windows (https://learn.microsoft.com/en-us/azure/ai-services/openai/whats-new#gpt-4-turbo-preview--gpt-35-tur..., but my input prompt DO NOT exceed the limit .
Why do i receive the error messages?

[samiak]

Hello,

Can you share more details (text/prompt...), I would like to reproduce the issue if possible.

You can send me a DM.

Thanks,

Samia

[takolota]

The take( ) expression can take any number of characters from a string