buzzcode2007/LLM-Self-Detection-Research
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

move models and prompts to testing config folder

Browse source
This commit is contained in:
buzz-lightsnack-2007 2024-12-04 13:03:25 +08:00
parent 3b94f13adc
commit b5970cac26
3 changed files with 13 additions and 9 deletions
Download patch file Download diff file Expand all files Collapse all files

5
tests/config/models.JSON Normal file
View file

@ -0,0 +1,5 @@
{
"Microsoft Phi": "phi",
"Gemma 2": "gemma2:2b",
"Tinyllama": "tinyllama"
}

8
tests/config/prompts.json Normal file
View file

@ -0,0 +1,8 @@
{
"sample": "Here are some examples that have already been identified as either human-written or AI-written. ",
"description": "Using the examples presented above, can you describe differences between works written by humans and by AI?",
"introduction": "Please help me determine whether the text was made by a human or an LLM:",
"classify": "Please help me determine whether this piece text above is written a human or by a large language model.",
"judge": "Try to consider both options before coming up with a single-choice conclusion.",
"answer format": "Your response must always end with your verdict in a new line that either contains “human” or “AI” without any additional words, quotation marks, formatting, or punctuations. Examples of responses include: \n“ABC \n\nhuman”\nor\n“DEF \n\nAI”\n\nwhere “ABC” and “DEF” are placeholders for your explanations."
}

9
tests/prompts.json
View file

@ -1,9 +0,0 @@
{
"descriptions": ["Below are some texts written by humans and by large language models.", "Given these, can you describe the differences between the human and AI written work?"],
"sample": "Below are some texts that have already been determined to be written by humans or LLMs. ",
"introduction": "Below is a selected piece of text:",
"classify": "Now, can you determine if the above piece of text is written by a human or by a large language model?",
"judge": "Now, can you determine if the above piece of text is written by a human or by a large language model? Please consider both options before coming up with a single-choice conclusion.",
"answer format": "Your answer must always end with your verdict in a new line that strictly contains either “human” or “AI.” DO NOT format this line with any Markdown formatting.",
"acceptable": ["human", "AI"]
}