The issue of JsonLoader displaying as ASCII in Chinese

[WenBin0625]

Checked other resources

• I added a very descriptive title to this question.
• I searched the LangChain documentation with the integrated search.
• I used the GitHub search to find a similar question and didn't find it.

Commit to Help

• I commit to help with one of those options 👆

Example Code

from langchain_community.document_loaders import JSONLoader


def generate_metadata(record: dict, metadata: dict):
    """
    构造元数据的方法
    :param record:读取到的每条数据的字典
    :param metadata:原始的元数据字典
    :return:metadata
    """
    metadata["gender"] = record["gender"]
    metadata["age"] = record["age"]

    return metadata

loader = JSONLoader(
    file_path="test.json",
    jq_schema=".datas_list[]",
    text_content=False,
    metadata_func=generate_metadata
)

json_data = loader.load()
print(json_data)

Description

While using JSONLoader to read a JSON file, the Chinese content read appears in the form of ASCII encoding. How can I make the Chinese content display properly?

this is output result：

[Document(metadata={'source': 'E:\big_model_study\LangChain_Study\RAG\test.json', 'seq_num': 1, 'gender': '男', 'age': 18}, page_content='{"id": 1, "name": "\u5f20\u4e09", "age": 18, "gender": "\u7537", "address": "\u4e0a\u6d77\u5e02\u5408\u80a5\u5e02\u9521\u5c71\u5f20\u8857t\u5ea7 546980"}')]

System Info

Name: langchain Version: 0.3.13
Name: langchain-community Version: 0.3.13
Name: jq Version: 1.8.0

os windows 11 26100.2605
python version Python 3.10.11

[WenBin0625]

I temporarily solved this problem by modifying the corresponding json. dumps() method in the _get_text method of the JSONLoader class and adding ensue_ascii=False.

[Bharat-homeopathy-psoriasis-care]

Dietary recommendations for patients suffering from psoriasis.
Foods that are rich in antioxidants may help in releasing oxidative stress, including fruits or vegetables, tea, coffee, herbs, spices, and even herbs. They also possess anti-inflammatory properties. It is also possible to try other foods rich in fibre, healthy fats and omega-3 fats. For instance:
Greens, berries, and leafy leaves, carrots and peaches
Lentils and beans
Avocados, extra-virgin olive oils, and walnuts
Flaxseed oil and wild salmon
Incorporating these food items into your diet could be beneficial as a natural treatment for psoriasis. But, there are certain foods that could negatively affect the condition and sufferers should avoid these items within their daily diet.