Skip to content

Commit

Permalink
community: tongyi multimodal response format fix to support langchain (
Browse files Browse the repository at this point in the history
…#28645)

Description: The multimodal(tongyi) response format "message": {"role":
"assistant", "content": [{"text": "图像"}]}}]} is not compatible with
LangChain.
Dependencies: No

---------

Co-authored-by: Erick Friis <[email protected]>
  • Loading branch information
achenglike and efriis authored Dec 10, 2024
1 parent d0e662e commit 3048a9a
Showing 1 changed file with 13 additions and 0 deletions.
13 changes: 13 additions & 0 deletions libs/community/langchain_community/chat_models/tongyi.py
Original file line number Diff line number Diff line change
Expand Up @@ -547,6 +547,19 @@ def _stream_completion_with_retry(**_kwargs: Any) -> Any:
if _kwargs.get("stream") and not _kwargs.get(
"incremental_output", False
):
# inline fix response text logic
resp_copy = json.loads(json.dumps(resp))
if resp_copy.get("output") and resp_copy["output"].get("choices"):
choice = resp_copy["output"]["choices"][0]
message = choice["message"]
if isinstance(message.get("content"), list):
content_text = "".join(
item.get("text", "")
for item in message["content"]
if isinstance(item, dict)
)
message["content"] = content_text
resp = resp_copy
if prev_resp is None:
delta_resp = resp
else:
Expand Down

0 comments on commit 3048a9a

Please sign in to comment.