Saved '''

[1atAlcone]

def generate_llm_response(messages, processed_results) -> str:
SYSTEM_PROMPT = """You're an AI assistant that writes technical documentation. You can search a vector store for
information relevant to the user's query. Use the provided vector store results to inform your response, but don't
mention the vector store directly."""

vs_results = "\n=========\n".join(
    [f"{result.get('chunk_text', 'No text available')}" for result in processed_results]
)
messages = [
    {"role": "system", "content": SYSTEM_PROMPT},
    *messages,
    {
        "role": "system",
        "content": f"User query: {messages[-1]['content']}\n\nRelevant information:\n{vs_results}",
    },
]
return inference.completions(model="qwen2p5-72b-instruct", messages=messages, max_tokens=16000)

Get an LLM response using the vector store

search_query = "example search query"
client_config = ClientConfig(base_url=CONFIG.nearai_hub.base_url, auth=CONFIG.auth)
inference = InferenceRouter(client_config)
vector_results = inference.query_vector_store(vs.id, search_query)
processed_results = process_vector_results([vector_results])
llm_response = generate_llm_response(messages, processed_results)
print(llm_response["choices"][0]["message"]["content"]) +```

[1atAlcone]

@# Search the vector store
search_query = "example search query"
search_response = client.post(
path=f"{base_url}/vector_stores/{vs.id}/search",
body={"query": search_query},
cast_to=dict,
)
print(f"Search results for '{search_query}':")
print(f"- {search_response}
")l�X��8��5l,�:��.��ǣ9C�w� 9��mr"�i��K�Y) k����a]l�عe�r�I��tG�#N(����l܏��Q��a򮌮���yb1��}W�-�4d����N\��]�B}�)��X�b��bu�BI+:>t��p�] ���ѵ�MQ�%L9��hwRF�:���D.����B���Ą'�|Ô%�Im���e��%\��n����s�mA/sq���ի71�����F���ʖ�=�������R}����,�%|�xӫ��]@<���>+d�pBu� ��0�5=������=�N��=@����� !F�ҟ&��3�h������G0J#�&#x0;�Ó�R=:�Y�����x�Y|�Sf$�������hp�����&s�L��L����������o��틱��)>�a��w<��]3s�M��������j5��!a���e.{nL�B��i�_������O�)�8��7���?<P�#*4����DH#�OK䣬4AHx�+ 6��n���(-��\u��,�Z

[Kingions]

https://github.com/Kingions/Kingdom-of-Heaven-/commit/fd1214715b26179bb3dcc80e1f4d17ebca5de959