The Roleplay Update 🎤

[Jeffser]

I've been transitioning Alpaca from using a JSON file and directories to save chats and attachments to a single instance of sqlite3 to do both.

It hasn't been easy but it's pretty much done, now that that's out of the way I made a new table to save...

MODEL PROFILE PICTURES!!!!

And yes, they are also represented in the chat itself.

Now the footer (should probably rename it at this point) is at the top of the messages, models with no pfp will make their messages fallback to the old button

And yes, the pfp acts as the options button now

Also the model creator is less scary when creating a model based on an existing model, this is not the full model creator I want to make in the future but it's good enough for now

[Jeffser]

ec8bf9c

[Ayanami-Rin]

Will you add a way to import older chats that are now defunct and not listed in the client with this update?

[Jeffser]

I think there's a problem with the code for extracting data from the attachments, I'll get it fixed for the next version

[Jeffser]

Can you try running Alpaca from the terminal?

My problem was caused because I manually modified the old chats so it was relevant, it would help me have your logs so I can see if there's something specific happening in your installation

[Ayanami-Rin]

ayanami@kaiju:~$ flatpak run com.jeffser.Alpaca 
INFO	[main.py | main] Alpaca version: 3.2.0
ERROR	[window.py | initial_convert_to_sql] UNIQUE constraint failed: message.id
INFO	[connection_handler.py | start] Starting Alpaca's Ollama instance...
INFO	[connection_handler.py | start] Started Alpaca's Ollama instance
Couldn't find '/home/ayanami/.ollama/id_ed25519'. Generating new private key.
Your new public key is: 

ssh-ed25519 AAAAC3***RszcrBxV

2025/01/10 21:27:59 routes.go:1259: INFO server config env="map[CUDA_VISIBLE_DEVICES: GPU_DEVICE_ORDINAL: HIP_VISIBLE_DEVICES: HSA_OVERRIDE_GFX_VERSION: HTTPS_PROXY: HTTP_PROXY: NO_PROXY: OLLAMA_DEBUG:true OLLAMA_FLASH_ATTENTION:false OLLAMA_GPU_OVERHEAD:0 OLLAMA_HOST:http://127.0.0.1:11435 OLLAMA_INTEL_GPU:false OLLAMA_KEEP_ALIVE:5m0s OLLAMA_KV_CACHE_TYPE: OLLAMA_LLM_LIBRARY: OLLAMA_LOAD_TIMEOUT:5m0s OLLAMA_MAX_LOADED_MODELS:0 OLLAMA_MAX_QUEUE:512 OLLAMA_MODELS:/home/ayanami/.var/app/com.jeffser.Alpaca/data/.ollama/models OLLAMA_MULTIUSER_CACHE:false OLLAMA_NOHISTORY:false OLLAMA_NOPRUNE:false OLLAMA_NUM_PARALLEL:0 OLLAMA_ORIGINS:[http://localhost https://localhost http://localhost:* https://localhost:* http://127.0.0.1 https://127.0.0.1 http://127.0.0.1:* https://127.0.0.1:* http://0.0.0.0 https://0.0.0.0 http://0.0.0.0:* https://0.0.0.0:* app://* file://* tauri://* vscode-webview://*] OLLAMA_SCHED_SPREAD:false ROCR_VISIBLE_DEVICES: http_proxy: https_proxy: no_proxy:]"
INFO	[connection_handler.py | start] client version is 0.5.4
time=2025-01-10T21:27:59.896+01:00 level=INFO source=images.go:757 msg="total blobs: 19"
[GIN-debug] [WARNING] Creating an Engine instance with the Logger and Recovery middleware already attached.
time=2025-01-10T21:27:59.897+01:00 level=INFO source=images.go:764 msg="total unused blobs removed: 0"

[GIN-debug] [WARNING] Running in "debug" mode. Switch to "release" mode in production.
time=2025-01-10T21:27:59.897+01:00 level=INFO source=routes.go:1310 msg="Listening on 127.0.0.1:11435 (version 0.5.4)"
 - using env:	export GIN_MODE=release
 - using code:	gin.SetMode(gin.ReleaseMode)

[GIN-debug] POST   /api/pull                 --> github.com/ollama/ollama/server.(*Server).PullHandler-fm (5 handlers)
[GIN-debug] POST   /api/generate             --> github.com/ollama/ollama/server.(*Server).GenerateHandler-fm (5 handlers)
[GIN-debug] POST   /api/chat                 --> github.com/ollama/ollama/server.(*Server).ChatHandler-fm (5 handlers)
[GIN-debug] POST   /api/embed                --> github.com/ollama/ollama/server.(*Server).EmbedHandler-fm (5 handlers)
[GIN-debug] POST   /api/embeddings           --> github.com/ollama/ollama/server.(*Server).EmbeddingsHandler-fm (5 handlers)
[GIN-debug] POST   /api/create               --> github.com/ollama/ollama/server.(*Server).CreateHandler-fm (5 handlers)
[GIN-debug] POST   /api/push                 --> github.com/ollama/ollama/server.(*Server).PushHandler-fm (5 handlers)
[GIN-debug] POST   /api/copy                 --> github.com/ollama/ollama/server.(*Server).CopyHandler-fm (5 handlers)
[GIN-debug] DELETE /api/delete               --> github.com/ollama/ollama/server.(*Server).DeleteHandler-fm (5 handlers)
[GIN-debug] POST   /api/show                 --> github.com/ollama/ollama/server.(*Server).ShowHandler-fm (5 handlers)
[GIN-debug] POST   /api/blobs/:digest        --> github.com/ollama/ollama/server.(*Server).CreateBlobHandler-fm (5 handlers)
[GIN-debug] HEAD   /api/blobs/:digest        --> github.com/ollama/ollama/server.(*Server).HeadBlobHandler-fm (5 handlers)
[GIN-debug] GET    /api/ps                   --> github.com/ollama/ollama/server.(*Server).PsHandler-fm (5 handlers)
[GIN-debug] POST   /v1/chat/completions      --> github.com/ollama/ollama/server.(*Server).ChatHandler-fm (6 handlers)
[GIN-debug] POST   /v1/completions           --> github.com/ollama/ollama/server.(*Server).GenerateHandler-fm (6 handlers)
[GIN-debug] POST   /v1/embeddings            --> github.com/ollama/ollama/server.(*Server).EmbedHandler-fm (6 handlers)
[GIN-debug] GET    /v1/models                --> github.com/ollama/ollama/server.(*Server).ListHandler-fm (6 handlers)
[GIN-debug] GET    /v1/models/:model         --> github.com/ollama/ollama/server.(*Server).ShowHandler-fm (6 handlers)
[GIN-debug] GET    /                         --> github.com/ollama/ollama/server.(*Server).GenerateRoutes.func1 (5 handlers)
[GIN-debug] GET    /api/tags                 --> github.com/ollama/ollama/server.(*Server).ListHandler-fm (5 handlers)
[GIN-debug] GET    /api/version              --> github.com/ollama/ollama/server.(*Server).GenerateRoutes.func2 (5 handlers)
[GIN-debug] HEAD   /                         --> github.com/ollama/ollama/server.(*Server).GenerateRoutes.func1 (5 handlers)
[GIN-debug] HEAD   /api/tags                 --> github.com/ollama/ollama/server.(*Server).ListHandler-fm (5 handlers)
[GIN-debug] HEAD   /api/version              --> github.com/ollama/ollama/server.(*Server).GenerateRoutes.func2 (5 handlers)
time=2025-01-10T21:27:59.897+01:00 level=DEBUG source=common.go:80 msg="runners located" dir=/app/lib/ollama/runners
time=2025-01-10T21:27:59.897+01:00 level=DEBUG source=common.go:124 msg="availableServers : found" file=/app/lib/ollama/runners/cpu_avx/ollama_llama_server
time=2025-01-10T21:27:59.897+01:00 level=DEBUG source=common.go:124 msg="availableServers : found" file=/app/lib/ollama/runners/cpu_avx2/ollama_llama_server
time=2025-01-10T21:27:59.897+01:00 level=DEBUG source=common.go:124 msg="availableServers : found" file=/app/lib/ollama/runners/cuda_v11_avx/ollama_llama_server
time=2025-01-10T21:27:59.897+01:00 level=DEBUG source=common.go:124 msg="availableServers : found" file=/app/lib/ollama/runners/cuda_v12_avx/ollama_llama_server
time=2025-01-10T21:27:59.897+01:00 level=DEBUG source=common.go:124 msg="availableServers : found" file=/app/lib/ollama/runners/rocm_avx/ollama_llama_server
time=2025-01-10T21:27:59.897+01:00 level=INFO source=routes.go:1339 msg="Dynamic LLM libraries" runners="[rocm_avx cpu cpu_avx cpu_avx2 cuda_v11_avx cuda_v12_avx]"
time=2025-01-10T21:27:59.897+01:00 level=DEBUG source=routes.go:1340 msg="Override detection logic by setting OLLAMA_LLM_LIBRARY"
time=2025-01-10T21:27:59.897+01:00 level=DEBUG source=sched.go:105 msg="starting llm scheduler"
time=2025-01-10T21:27:59.897+01:00 level=INFO source=gpu.go:226 msg="looking for compatible GPUs"
time=2025-01-10T21:27:59.899+01:00 level=DEBUG source=gpu.go:99 msg="searching for GPU discovery libraries for NVIDIA"
time=2025-01-10T21:27:59.899+01:00 level=DEBUG source=gpu.go:517 msg="Searching for GPU library" name=libcuda.so*
time=2025-01-10T21:27:59.899+01:00 level=DEBUG source=gpu.go:543 msg="gpu library search" globs="[/app/lib/ollama/libcuda.so* /app/lib/ollama/libcuda.so* /app/lib/libcuda.so* /usr/lib/x86_64-linux-gnu/GL/default/lib/libcuda.so* /usr/lib/x86_64-linux-gnu/openh264/extra/libcuda.so* /usr/lib/x86_64-linux-gnu/openh264/extra/libcuda.so* /usr/lib/sdk/llvm15/lib/libcuda.so* /usr/lib/x86_64-linux-gnu/GL/default/lib/libcuda.so* /usr/lib/ollama/libcuda.so* /app/plugins/AMD/lib/ollama/libcuda.so* /usr/local/cuda*/targets/*/lib/libcuda.so* /usr/lib/*-linux-gnu/nvidia/current/libcuda.so* /usr/lib/*-linux-gnu/libcuda.so* /usr/lib/wsl/lib/libcuda.so* /usr/lib/wsl/drivers/*/libcuda.so* /opt/cuda/lib*/libcuda.so* /usr/local/cuda/lib*/libcuda.so* /usr/lib*/libcuda.so* /usr/local/lib*/libcuda.so*]"
time=2025-01-10T21:27:59.900+01:00 level=DEBUG source=gpu.go:577 msg="discovered GPU libraries" paths=[]
time=2025-01-10T21:27:59.900+01:00 level=DEBUG source=gpu.go:517 msg="Searching for GPU library" name=libcudart.so*
time=2025-01-10T21:27:59.900+01:00 level=DEBUG source=gpu.go:543 msg="gpu library search" globs="[/app/lib/ollama/libcudart.so* /app/lib/ollama/libcudart.so* /app/lib/libcudart.so* /usr/lib/x86_64-linux-gnu/GL/default/lib/libcudart.so* /usr/lib/x86_64-linux-gnu/openh264/extra/libcudart.so* /usr/lib/x86_64-linux-gnu/openh264/extra/libcudart.so* /usr/lib/sdk/llvm15/lib/libcudart.so* /usr/lib/x86_64-linux-gnu/GL/default/lib/libcudart.so* /usr/lib/ollama/libcudart.so* /app/plugins/AMD/lib/ollama/libcudart.so* /app/lib/ollama/libcudart.so* /app/lib/ollama/libcudart.so* /usr/local/cuda/lib64/libcudart.so* /usr/lib/x86_64-linux-gnu/nvidia/current/libcudart.so* /usr/lib/x86_64-linux-gnu/libcudart.so* /usr/lib/wsl/lib/libcudart.so* /usr/lib/wsl/drivers/*/libcudart.so* /opt/cuda/lib64/libcudart.so* /usr/local/cuda*/targets/aarch64-linux/lib/libcudart.so* /usr/lib/aarch64-linux-gnu/nvidia/current/libcudart.so* /usr/lib/aarch64-linux-gnu/libcudart.so* /usr/local/cuda/lib*/libcudart.so* /usr/lib*/libcudart.so* /usr/local/lib*/libcudart.so*]"
time=2025-01-10T21:27:59.901+01:00 level=DEBUG source=gpu.go:577 msg="discovered GPU libraries" paths="[/app/lib/ollama/libcudart.so.11.3.109 /app/lib/ollama/libcudart.so.12.4.127]"
CUDA driver version: 12-7
time=2025-01-10T21:28:00.055+01:00 level=DEBUG source=gpu.go:149 msg="detected GPUs" library=/app/lib/ollama/libcudart.so.11.3.109 count=1
[GPU-e4f96b56-ba5b-496e-8ec9-1eed30d86df2] CUDA totalMem 23641784320
[GPU-e4f96b56-ba5b-496e-8ec9-1eed30d86df2] CUDA freeMem 22253928448
[GPU-e4f96b56-ba5b-496e-8ec9-1eed30d86df2] CUDA usedMem 0
[GPU-e4f96b56-ba5b-496e-8ec9-1eed30d86df2] Compute Capability 8.9
time=2025-01-10T21:28:00.161+01:00 level=DEBUG source=amd_linux.go:421 msg="amdgpu driver not detected /sys/module/amdgpu"
releasing cudart library
time=2025-01-10T21:28:00.235+01:00 level=INFO source=types.go:131 msg="inference compute" id=GPU-e4f96b56-ba5b-496e-8ec9-1eed30d86df2 library=cuda variant=v11 compute=8.9 driver=0.0 name="" total="22.0 GiB" available="20.7 GiB"
[GIN] 2025/01/10 - 21:28:00 | 200 |     648.132µs |       127.0.0.1 | GET      "/api/tags"
[GIN] 2025/01/10 - 21:28:00 | 200 |   14.863482ms |       127.0.0.1 | POST     "/api/show"
[GIN] 2025/01/10 - 21:28:00 | 200 |   16.541291ms |       127.0.0.1 | POST     "/api/show"
[GIN] 2025/01/10 - 21:28:00 | 200 |   30.329722ms |       127.0.0.1 | POST     "/api/show"
[GIN] 2025/01/10 - 21:28:00 | 200 |   31.431101ms |       127.0.0.1 | POST     "/api/show"
INFO	[window.py | closing_app] Closing app...
INFO	[connection_handler.py | stop] Stopping Alpaca's Ollama instance
INFO	[connection_handler.py | stop] Stopped Alpaca's Ollama instance
ayanami@kaiju:~$ 

[Jeffser]

This line seems to be the problem

ERROR [window.py | initial_convert_to_sql] UNIQUE constraint failed: message.id

I'll see what I can do

[Jeffser]

Well there's an easier way of doing this actually.

1. Move ~/.var/app/com.jeffser.Alpaca/data/chats_test.db somewhere else
2. Make sure the directory is named chats and not chats_OLD
3. Run Alpaca, it will reset and force the importing of old chats
4. Press CTRL+i and select the file you moved before (chats_test.db)