[Inference]Fix example in readme (#6178)

hpcaitech · Jan 8, 2025 · 5b094a8 · 5b094a8
1 parent ee81366
commit 5b094a8
Showing 1 changed file with 1 addition and 1 deletion.
diff --git a/colossalai/inference/README.md b/colossalai/inference/README.md
@@ -62,7 +62,7 @@ engine = InferenceEngine(model, tokenizer, inference_config, verbose=True)
 
 # Step 4: try inference
 prompts = ['Who is the best player in the history of NBA?']
-response = engine.generate(prompts)
+response = engine.generate(prompts=prompts)
 pprint(response)
 ```