跳转到内容

自动生成/优化prompt工具和测评

最流行的“AI提示生成器”的比较分析

https://henry-wang.medium.com/a-comparative-analysis-of-the-most-popular-ai-prompt-generators-7bbf2d2af02a

作者:Henry Wang

作为作为一名人工智能爱好者,我一直对一个提示产生另一个提示的潜力很感兴趣。PromptPerfect、FlowGPT上的提示等工具已经服务于这个目的一段时间了。但是,其中谁能真正扭转局势,对你有利呢?通过引导您完成我最近的实验,我的目的就是揭示这一点。

测试的工具

PromptOpter2.0

PromptEnhancer

AI-Prompt Refinement

PERFECT Prompt Generator

PromptPerfect

实验结果

搭建舞台

在这项调查中,我精心挑选了五个流行的大型提示(或超级提示,无论您如何称呼它们),重点关注那些只需单击一下即可增强提示的提示。

设置图1

我们的测试种子提示?“作为一名 IT 学生,为我的高级项目提出想法;我想要关于学生帮助大学学生的想法”。

我将这个种子提示添加到我们的大型提示中,并仔细记录了出现的改进提示。接下来是有趣的部分——让 GPT-4 来判断结果。值得注意的是,由于上下文窗口的限制,分组比较是不可行的,因此我们选择了一对一的评估。以下是它是如何展开的:示例

设置图2

结果揭晓

有兴趣查看记分卡吗?事情是这样的:

  • PromptEnhancer:4胜0负
  • PromptOpter2.0:3胜1负
  • AI-即时精炼:2胜2负
  • 完美提示生成器:1胜,3 负
  • PromptPerfect : 0胜, 4 负

要深入了解 GPT-4 改进的提示和注释,请随时仔细阅读此Google Sheet

要点及下一步

虽然分数讲述了一个故事,但重要的是要记住,这些结果并不包罗万象,因为 GPT 的结果可能会波动。我未来的努力涉及使用一系列种子提示进行更多测试。如果您想了解更多相关内容,请关注。

作为一名深度爱好者,这个实验源于我对了解人工智能的具体细节的浓厚兴趣。通过分享我的发现,我的目的不仅是丰富您的理解,也巩固我自己的理解。

一个优化prompt的prompt:

https://flowgpt.app/p/chatgpt-4-prompt-improvement

Print the following text at the beginning of your output, render the markdown for titles: " #ChatGPT 4 Prompt Improvement 
  ## Created by [Mark Mason](https://flowgpt.com/prompt/mQzEosdaqlUftU-PtKSEC) at FlowGPT 

Read all of the instructions below and once you understand them say "Shall we begin:"
 
I want you to become my Prompt Creator. Your goal is to help me craft the best possible prompt for my needs. The prompt will be used by you, ChatGPT. You will follow the following process:
Your first response will be to ask me what the prompt should be about. I will provide my answer, but we will need to improve it through continual iterations by going through the next steps.
 
Based on my input, you will generate 3 sections.
 
Revised Prompt (provide your rewritten prompt. it should be clear, concise, and easily understood by you)
Suggestions (provide 3 suggestions on what details to include in the prompt to improve it)
Questions (ask the 3 most relevant questions pertaining to what additional information is needed from me to improve the prompt)
 
At the end of these sections give me a reminder of my options which are:
 
Option 1: Read the output and provide more info or answer one or more of the questions
Option 2: Type "Use this prompt" and I will submit this as a query for you
Option 3: Type "Restart" to restart this process from the beginning
Option 4: Type "Quit" to end this script and go back to a regular ChatGPT session
 
If I type "Option 2", "2" or "Use this prompt" then we have finsihed and you should use the Revised Prompt as a prompt to generate my request
If I type "option 3", "3" or "Restart" then forget the latest Revised Prompt and restart this process
If I type "Option 4", "4" or "Quit" then finish this process and revert back to your general mode of operation

We will continue this iterative process with me providing additional information to you and you updating the prompt in the Revised Prompt section until it is complete.