How to optimize your OpenAI API token usage - Revision history

Planetoid at 06:05, 11 December 2024

2024-12-11T06:05:09Z

← Older revision		Revision as of 14:05, 11 December 2024
Line 121:		Line 121:
	<references />		<references />

	[[Category:OpenAI]]		[[Category: Generative AI]] [[Category: Software]] [[Category: OpenAI]]

Planetoid: /* Constraining Bot Responses to Predefined Options */

2024-12-11T06:04:24Z

Constraining Bot Responses to Predefined Options

← Older revision		Revision as of 14:04, 11 December 2024
Line 10:		Line 10:

	=== Constraining Bot Responses to Predefined Options ===		=== Constraining Bot Responses to Predefined Options ===
	While it's acceptable to pose open-ended questions to explore the capabilities of ChatGPT, keep in mind that such questions can lead to longer, more creative responses that might increase costs. To achieve concise and cost-effective answers, (1) consider refining your question by providing specific and limited options for the AI to select from. (2) if not applicable, respond with N/A. This prevents responses with text outside the options, which not only uses additional tokens but also increases the effort needed for subsequent data cleaning.		While it's acceptable to pose open-ended questions to explore the capabilities of ChatGPT, keep in mind that such questions can lead to longer, more creative responses that might increase costs. To achieve concise and cost-effective answers, (1) consider refining your question by providing specific and limited options for the AI to select from.

			(2) if not applicable, respond with N/A. This prevents responses with text outside the options. For example, when analyzing news articles to find key technology-related news summaries, if we don't predefine how the AI should respond when no relevant information is found, the AI might respond with variations like:

			* NA
			* None
			* No major technology news today
			* No major technology news reports today
			* Due to lack of news content, unable to provide technology news summary

			This variation in responses which not only uses additional tokens but also increases the effort needed for subsequent data cleaning.

	For example:		For example:

Planetoid: /* Select the appropriate model */

2024-12-10T07:13:12Z

Select the appropriate model

← Older revision		Revision as of 15:13, 10 December 2024
Line 75:		Line 75:

	=== Select the appropriate model ===		=== Select the appropriate model ===
	For complex tasks, GPT-4 is recommended, while simpler tasks like translation can utilize GPT-3.5. For more information, please refer to the following article: [https://platform.openai.com/docs/models Models - OpenAI API].		For complex tasks, GPT-4 is recommended, while simpler tasks like translation can utilize GPT-3.5. The same task can start with the xx-mini model. For example, if the o1-mini model can already handle general tasks adequately, there's no need to use the more costly and time-consuming o1 model. For more information, please refer to the following article: [https://platform.openai.com/docs/models Models - OpenAI API].

	=== Enable the JSON mode ===		=== Enable the JSON mode ===

Planetoid: /* Constraining Bot Responses to Predefined Options */

2024-12-10T07:09:35Z

Constraining Bot Responses to Predefined Options

← Older revision		Revision as of 15:09, 10 December 2024
Line 10:		Line 10:

	=== Constraining Bot Responses to Predefined Options ===		=== Constraining Bot Responses to Predefined Options ===
	While it's acceptable to pose open-ended questions to explore the capabilities of ChatGPT, keep in mind that such questions can lead to longer, more creative responses that might increase costs. To achieve concise and cost-effective answers, consider refining your question by providing specific and limited options for the AI to select from.		While it's acceptable to pose open-ended questions to explore the capabilities of ChatGPT, keep in mind that such questions can lead to longer, more creative responses that might increase costs. To achieve concise and cost-effective answers, (1) consider refining your question by providing specific and limited options for the AI to select from. (2) if not applicable, respond with N/A. This prevents responses with text outside the options, which not only uses additional tokens but also increases the effort needed for subsequent data cleaning.

	For example:		For example:

Planetoid: /* Streamlining Questions and Responses */

2024-12-10T07:07:39Z

Streamlining Questions and Responses

← Older revision		Revision as of 15:07, 10 December 2024
Line 9:		Line 9:
	If the results of a task calling the OpenAI API do not need to frequently change, consider storing the results for reuse. For example, you can store the results of short article translations, and before calling the API to translate again, check if it has already been translated before.		If the results of a task calling the OpenAI API do not need to frequently change, consider storing the results for reuse. For example, you can store the results of short article translations, and before calling the API to translate again, check if it has already been translated before.

	=== ~~Streamlining Questions and~~ Responses ===		=== Constraining Bot Responses to Predefined Options ===
	While it's acceptable to pose open-ended questions to explore the capabilities of ChatGPT, keep in mind that such questions can lead to longer, more creative responses that might increase costs. To achieve concise and cost-effective answers, consider refining your question by providing specific and limited options for the AI to select from.		While it's acceptable to pose open-ended questions to explore the capabilities of ChatGPT, keep in mind that such questions can lead to longer, more creative responses that might increase costs. To achieve concise and cost-effective answers, consider refining your question by providing specific and limited options for the AI to select from.

Line 31:		Line 31:
	```		```
	</pre>		</pre>


	=== Handling Multiple Article Packages ===		=== Handling Multiple Article Packages ===

Planetoid: /* Preparation Before API Result Verification */

2024-12-10T07:01:57Z

Preparation Before API Result Verification

← Older revision		Revision as of 15:01, 10 December 2024
Line 92:		Line 92:

	Prepare several sample texts and verify the API results to ensure they are as expected before processing a large number of articles.		Prepare several sample texts and verify the API results to ensure they are as expected before processing a large number of articles.

			=== Using OpenAI Batch API for Non-Real-Time Processing ===

			If real-time response is not required for the output data, you can consider using the [https://platform.openai.com/docs/api-reference/batch OpenAI Batch API]

	== Another version of this article ==		== Another version of this article ==

Planetoid: /* Methods for enhancing the efficiency of your OpenAI API token usage. */

2024-03-01T02:39:15Z

Methods for enhancing the efficiency of your OpenAI API token usage.

← Older revision		Revision as of 10:39, 1 March 2024
Line 4:		Line 4:
	=== Prevent Sending Duplicate Content to the OpenAI API ===		=== Prevent Sending Duplicate Content to the OpenAI API ===
	* [https://errerrors.blogspot.com/2023/08/how-to-find-duplicate-text-values-in-mysql.html MySQL 如何尋找重複的文章 (文字類型資料)] in Tradition Chinese.		* [https://errerrors.blogspot.com/2023/08/how-to-find-duplicate-text-values-in-mysql.html MySQL 如何尋找重複的文章 (文字類型資料)] in Tradition Chinese.

			'''Cache the API result'''

			If the results of a task calling the OpenAI API do not need to frequently change, consider storing the results for reuse. For example, you can store the results of short article translations, and before calling the API to translate again, check if it has already been translated before.

	=== Streamlining Questions and Responses ===		=== Streamlining Questions and Responses ===

Unknown user at 04:35, 15 January 2024

2024-01-15T04:35:26Z

← Older revision		Revision as of 12:35, 15 January 2024
Line 1:		Line 1:
	How to optimize your OpenAI API token usage		How to optimize your OpenAI API token usage

	== Prevent Sending Duplicate Content to the OpenAI API ==		== Methods for enhancing the efficiency of your OpenAI API token usage. ==
			=== Prevent Sending Duplicate Content to the OpenAI API ===
	* [https://errerrors.blogspot.com/2023/08/how-to-find-duplicate-text-values-in-mysql.html MySQL 如何尋找重複的文章 (文字類型資料)] in Tradition Chinese.		* [https://errerrors.blogspot.com/2023/08/how-to-find-duplicate-text-values-in-mysql.html MySQL 如何尋找重複的文章 (文字類型資料)] in Tradition Chinese.

	== Streamlining Questions and Responses ==		=== Streamlining Questions and Responses ===
	While it's acceptable to pose open-ended questions to explore the capabilities of ChatGPT, keep in mind that such questions can lead to longer, more creative responses that might increase costs. To achieve concise and cost-effective answers, consider refining your question by providing specific and limited options for the AI to select from.		While it's acceptable to pose open-ended questions to explore the capabilities of ChatGPT, keep in mind that such questions can lead to longer, more creative responses that might increase costs. To achieve concise and cost-effective answers, consider refining your question by providing specific and limited options for the AI to select from.

Line 28:		Line 29:


	== Handling Multiple Article Packages ==		=== Handling Multiple Article Packages ===

	original promot		original promot
Line 59:		Line 60:
	</pre>		</pre>

	== No Additional Explanation Needed ==		=== No Additional Explanation Needed ===

	While GPT-4 often attempts to provide explanations for its answers, if you have already explored the topic, you can frame your questions in a way that skips the elaboration. For example:		While GPT-4 often attempts to provide explanations for its answers, if you have already explored the topic, you can frame your questions in a way that skips the elaboration. For example:
Line 70:		Line 71:
	</pre>		</pre>

	== Select the appropriate model ==		=== Select the appropriate model ===
	For complex tasks, GPT-4 is recommended, while simpler tasks like translation can utilize GPT-3.5. For more information, please refer to the following article: [https://platform.openai.com/docs/models Models - OpenAI API].		For complex tasks, GPT-4 is recommended, while simpler tasks like translation can utilize GPT-3.5. For more information, please refer to the following article: [https://platform.openai.com/docs/models Models - OpenAI API].

	== Choose Long Article Splitting Strategy (chunk) ==		=== Enable the JSON mode ===
			* "Compatible with gpt-4-1106-preview and gpt-3.5-turbo-1106.<ref>[https://platform.openai.com/docs/api-reference/chat/create API Reference - OpenAI API]</ref>"

			=== Choose Long Article Splitting Strategy (chunk) ===

	Different language models have token limits that affect how much text they can process. The max_length API parameter accounts for both input and output. Models like gpt3.5-turbo and gpt-4 have specific token limits like 4,097 and 8,192, respectively. Exceeding these limits requires you to split articles into smaller pieces for processing.		Different language models have token limits that affect how much text they can process. The max_length API parameter accounts for both input and output. Models like gpt3.5-turbo and gpt-4 have specific token limits like 4,097 and 8,192, respectively. Exceeding these limits requires you to split articles into smaller pieces for processing.
Line 81:		Line 85:
	For article splitting, tools like LangChain's [https://github.com/langchain-ai/text-split-explorer text-split-explorer] can help, offering options for delimiters, chunk size, and chunk overlap.		For article splitting, tools like LangChain's [https://github.com/langchain-ai/text-split-explorer text-split-explorer] can help, offering options for delimiters, chunk size, and chunk overlap.

	== Preparation Before API Result Verification ==		=== Preparation Before API Result Verification ===

	Prepare several sample texts and verify the API results to ensure they are as expected before processing a large number of articles.		Prepare several sample texts and verify the API results to ensure they are as expected before processing a large number of articles.
Line 96:		Line 100:
	* [https://www.reddit.com/r/OpenAI/comments/13scry1/how_to_reduce_your_openai_costs_by_up_to_30_3/ How to Reduce Your OpenAI Costs by up to 30% - 3 Simple Steps 💰 : OpenAI]		* [https://www.reddit.com/r/OpenAI/comments/13scry1/how_to_reduce_your_openai_costs_by_up_to_30_3/ How to Reduce Your OpenAI Costs by up to 30% - 3 Simple Steps 💰 : OpenAI]
	* [https://api.python.langchain.com/en/latest/_modules/langchain/text_splitter.html#RecursiveCharacterTextSplitter langchain.text_splitter — 🦜🔗 LangChain 0.0.280]		* [https://api.python.langchain.com/en/latest/_modules/langchain/text_splitter.html#RecursiveCharacterTextSplitter langchain.text_splitter — 🦜🔗 LangChain 0.0.280]

			== References ==
			<references />

	[[Category:OpenAI]]		[[Category:OpenAI]]

Unknown user: /* Further reading */

2023-09-03T10:05:24Z

Unknown user at 09:02, 3 September 2023

2023-09-03T09:02:15Z

← Older revision		Revision as of 17:02, 3 September 2023
Line 84:		Line 84:

	Prepare several sample texts and verify the API results to ensure they are as expected before processing a large number of articles.		Prepare several sample texts and verify the API results to ensure they are as expected before processing a large number of articles.

			== Another version of this article ==
			* Blog article written in Traditional Chinese: [https://errerrors.blogspot.com/2023/08/how-to-save-pocket-money-using-openai-api.html 把關你的荷包，怎樣節省使用 OpenAI API token]
			* Blog article written in English: [https://errerrors.blogspot.com/2023/08/how-i-save-openai-api-token-usage.html How I save the OpenAI API token usage]

	== Related pages ==		== Related pages ==

← Older revision		Revision as of 18:05, 3 September 2023
Line 95:		Line 95:
	* [https://help.openai.com/en/articles/6654000-best-practices-for-prompt-engineering-with-openai-api Best practices for prompt engineering with OpenAI API \| OpenAI Help Center]		* [https://help.openai.com/en/articles/6654000-best-practices-for-prompt-engineering-with-openai-api Best practices for prompt engineering with OpenAI API \| OpenAI Help Center]
	* [https://www.reddit.com/r/OpenAI/comments/13scry1/how_to_reduce_your_openai_costs_by_up_to_30_3/ How to Reduce Your OpenAI Costs by up to 30% - 3 Simple Steps 💰 : OpenAI]		* [https://www.reddit.com/r/OpenAI/comments/13scry1/how_to_reduce_your_openai_costs_by_up_to_30_3/ How to Reduce Your OpenAI Costs by up to 30% - 3 Simple Steps 💰 : OpenAI]
			* [https://api.python.langchain.com/en/latest/_modules/langchain/text_splitter.html#RecursiveCharacterTextSplitter langchain.text_splitter — 🦜🔗 LangChain 0.0.280]

	[[Category:OpenAI]]		[[Category:OpenAI]]