[langchain_community.llms.xinference]: Rewrite _stream() method and support stream() method in xinference.py

[TheSongg]

• PR title:[langchain_community.llms.xinference]: Rewrite _stream() method and support stream() method in xinference.py

• PR message: Rewrite the _stream method so that the chain.stream() can be used to return data streams.

   chain = prompt | llm
   chain.stream(input=user_input)
  

• tests:
  from langchain_community.llms import Xinference
  from langchain.prompts import PromptTemplate

  llm = Xinference(
      server_url="http://0.0.0.0:9997",  # replace your xinference server url
      model_uid={model_uid}  # replace model_uid with the model UID return from launching the model
      stream = True
   )
  prompt = PromptTemplate(input=['country'], template="Q: where can we visit in the capital of {country}? A:")
  chain = prompt | llm
  chain.stream(input={'country': 'France'})
  

[vercel]

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name	Status	Preview	Comments	Updated (UTC)
langchain	✅ Ready (Inspect)	Visit Preview	💬 Add feedback	Jan 17, 2025 3:10am