add text-davinci-003 to comparisons

README.md

@@ -58,10 +58,12 @@ PRs adapting this code to multi-GPU setups and larger models are always welcome.
 
 **Instruction**: Tell me about alpacas.
 
-**Alpaca-LoRA**: Alpacas are small, domesticated animals native to South America and related to llamas and camels. They have long necks, large eyes, and soft woolly coats in various colors such as white, brown, grey, black, and fawn. Alpaca herds can be found grazing on mountain slopes or plains throughout Peru, Bolivia, Chile, Ecuador, and Argentina.
+**Alpaca-LoRA**: Alpacas are members of the camelid family and are native to the Andes Mountains of South America. They are known for their soft, luxurious fleece, which is used to make clothing, blankets, and other items. Alpacas are herbivores and graze on grasses and other plants. They are social animals and live in herds of up to 20 individuals.
 
 **Stanford Alpaca**: Alpacas are small, fluffy animals related to camels and llamas. They are native to Peru and Bolivia, and were first domesticated around 5,000 years ago. They are kept mainly for their fine, soft fleece, which is used to make knitwear and other garments. Alpacas are herd animals and live in small family groups, led by an older male. They are highly social animals and can form strong bonds with their owners.
 
+**text-davinci-003**: Alpacas are a domesticated species of South American camelid, similar to llamas. They are native to the Andes Mountains in South America and are kept as livestock for their soft, luxurious wool. Alpacas are social animals and live in herds of up to 20 individuals. They are typically kept in small herds of two to five animals, and are relatively easy to care for. Alpacas are herbivores and feed on grass, hay, and other vegetation. They are also known for their gentle and friendly nature, making them popular as pets.
+
 ---
 
 **Instruction**: Tell me about the president of Mexico in 2019.
@@ -70,6 +72,8 @@ PRs adapting this code to multi-GPU setups and larger models are always welcome.
 
 **Stanford Alpaca**: In 2019, Andres Manuel Lopez Obrador was sworn in as President of Mexico. He is the country’s 58th president and the first from the left-wing Morena party. He was elected in 2018 on a promise to combat corruption and reduce poverty and has faced criticism for his handling of the economy, crime and the country’s relationship with the United States. He is also known for his ambitious social welfare programs and has been praised for raising the minimum wage and providing aid to low-income families. He is seen as a champion of democracy and human rights in Mexico.
 
+**text-davinci-003**: The president of Mexico in 2019 is Andrés Manuel López Obrador, commonly known as AMLO. He is a Mexican politician who has been the President of Mexico since December 1, 2018. He is a member of the National Regeneration Movement (MORENA) party and previously served as the Head of Government of Mexico City from 2000 to 2005. He is a left-wing populist and has promised to reduce corruption and inequality in Mexico. He has also promised to increase public spending on social programs and infrastructure projects.
+
 ---
 
 **Instruction**: Tell me about the king of France in 2019.
@@ -78,6 +82,8 @@ PRs adapting this code to multi-GPU setups and larger models are always welcome.
 
 **Stanford Alpaca**: In 2019, the King of France was Emmanuel Macron. He was sworn in as President of France on May 14, 2017, and has been leading the country ever since. He is a member of the centrist La République En Marche! Party. He is known for his reformist agenda and has faced a number of protests from both the right and left of the political spectrum. He is the youngest French president in history.
 
+**text-davinci-003**: The King of France is a largely symbolic role, as France is a republic. The current President of France is Emmanuel Macron, who was elected in 2017.
+
 ---
 
 **Instruction**: List all Canadian provinces in alphabetical order.
@@ -86,6 +92,22 @@ PRs adapting this code to multi-GPU setups and larger models are always welcome.
 
 **Stanford Alpaca**: Alberta, British Columbia, Manitoba, New Brunswick, Newfoundland and Labrador, Nova Scotia, Ontario, Prince Edward Island, Quebec, Saskatchewan, Northwest Territories, Nunavut, Yukon.
 
+**text-davinci-003**:
+
+1. Alberta
+2. British Columbia
+3. Manitoba
+4. New Brunswick
+5. Newfoundland and Labrador
+6. Northwest Territories
+7. Nova Scotia
+8. Nunavut
+9. Ontario
+10. Prince Edward Island
+11. Quebec
+12. Saskatchewan
+13. Yukon
+
 ---
 
 **Instruction**: Write a Python program that prints the first 10 Fibonacci numbers.
@@ -116,6 +138,30 @@ print(numbers)
 # Output: [0, 1, 1, 2, 3, 5, 8, 13, 21, 34]
 ```
 
+**text-davinci-003**:
+
+```python
+# Fibonacci numbers are the numbers in the following integer sequence, called the Fibonacci sequence, and characterized by the fact that every number after the first two is the sum of the two preceding ones.
+
+# Fibonacci sequence: 0, 1, 1, 2, 3, 5, 8, 13, 21, 34, ...
+
+# Program:
+
+# Initialize the first two numbers of the Fibonacci sequence
+a = 0
+b = 1
+
+# Print the first 10 numbers of the Fibonacci sequence
+print(a)
+print(b)
+
+for i in range(2,10):
+    c = a + b
+    a = b
+    b = c
+    print(c)
+```
+
 ---
 
 **Instruction**: Write a program that prints the numbers from 1 to 100. But for multiples of three print 'Fizz' instead of the number and for the multiples of five print 'Buzz'. For numbers which are multiples of both three and five print 'FizzBuzz'.
@@ -148,6 +194,22 @@ for i in range(1, 101):
         print(i)
 ```
 
+**text-davinci-003**:
+
+```javascript
+for (let i = 1; i <= 100; i++) {
+  if (i % 3 === 0 && i % 5 === 0) {
+    console.log("FizzBuzz");
+  } else if (i % 3 === 0) {
+    console.log("Fizz");
+  } else if (i % 5 === 0) {
+    console.log("Buzz");
+  } else {
+    console.log(i);
+  }
+}
+```
+
 ---
 
 **Instruction**: Tell me five words that rhyme with 'shock'.
@@ -156,6 +218,14 @@ for i in range(1, 101):
 
 **Stanford Alpaca**: Five words that rhyme with shock are: rock, pop, shock, cook, and snock.
 
+**text-davinci-003**:
+
+1. Block
+2. Lock
+3. Dock
+4. Clock
+5. Rock
+
 ---
 
 **Instruction**: Translate the sentence 'I have no mouth but I must scream' into Spanish.
@@ -163,3 +233,5 @@ for i in range(1, 101):
 **Alpaca-LoRA**: No tengo boca pero tengo que gritar.
 
 **Stanford Alpaca**: No tengo boca, pero debo gritar.
+
+**text-davinci-003**: No tengo boca pero debo gritar.

generate.py

@@ -37,7 +37,7 @@ def evaluate(instruction, input=None, **kwargs):
     input_ids = inputs["input_ids"].cuda()
     generation_config = GenerationConfig(
         temperature=0.1,
-        top_p=0.95,
+        top_p=0.75,
         num_beams=4,
         **kwargs,
     )