-
Notifications
You must be signed in to change notification settings - Fork 200
Pull requests: openvinotoolkit/openvino.genai
Author
Label
Projects
Milestones
Reviews
Assignee
Sort
Pull requests list
[DO NOT MERGE] Reproducer for memory leak
do_not_merge
no-match-files
#1547
opened Jan 14, 2025 by
vshampor
Loading…
[CB] Split token streaming and generation to different threads for all CB based pipelines
category: continuous batching
Continuous batching
category: prompt lookup
category: samples
GenAI samples
category: speculative decoding
Speculative decoding
Fixed streamer without corrupting hieroglyphs
bug
Something isn't working
category: LLM
LLM pipeline (stateful, static)
category: samples
GenAI samples
category: visual language
Visual language pipeline
Code Freeze
no-match-files
Debug qwen
category: LLM
LLM pipeline (stateful, static)
category: samples
GenAI samples
#1537
opened Jan 13, 2025 by
AsyaPronina
•
Draft
Automatically apply chat template in non-chat scenarios
category: GenAI C++ API
Changes in GenAI C++ public headers
category: GHA
CI based on Github actions
category: LLM
LLM pipeline (stateful, static)
category: samples
GenAI samples
category: tokenizers
Tokenizer class or submodule update
category: visual language
Visual language pipeline
no-match-files
[Tokenizers] add max_lengh parametrisation to encode
category: GenAI C++ API
Changes in GenAI C++ public headers
category: Python API
Python API for GenAI
category: tokenizers
Tokenizer class or submodule update
enhancement
New feature or request
Phi 3.5 vision instruct
category: visual language
Visual language pipeline
no-match-files
#1516
opened Jan 9, 2025 by
Wovchena
Loading…
Add MSVC Support For UTF-8 in Chat Sample
category: samples
GenAI samples
#1483
opened Jan 6, 2025 by
sammysun0711
Loading…
Add a choice of how to end streaming from callback: STOP or CANCEL
category: continuous batching
Continuous batching
category: GenAI C++ API
Changes in GenAI C++ public headers
category: LLM
LLM pipeline (stateful, static)
category: prompt lookup
category: Python API
Python API for GenAI
category: samples
GenAI samples
category: speculative decoding
Speculative decoding
category: visual language
Visual language pipeline
no-match-files
Concurrency in stable-diffusion image generation
category: cmake / build
Cmake scripts
category: GenAI C++ API
Changes in GenAI C++ public headers
category: samples
GenAI samples
category: text to image
Text 2 image pipeline
no-match-files
[TESTS] ensure initial prompt is long for perf metrics tests
category: LLM
LLM pipeline (stateful, static)
#1471
opened Jan 3, 2025 by
pavel-esir
•
Draft
Improve perf tests release
bug
Something isn't working
category: LLM
LLM pipeline (stateful, static)
no-match-files
#1468
opened Jan 3, 2025 by
pavel-esir
•
Draft
Add code quality checks to GitHub Actions
category: cmake / build
Cmake scripts
category: continuous batching
Continuous batching
category: GenAI C++ API
Changes in GenAI C++ public headers
category: GHA
CI based on Github actions
category: llm_bench
Label for tool/llm_bench folder
category: LLM
LLM pipeline (stateful, static)
category: LoRA
Low rank adapters
category: prompt lookup
category: Python API
Python API for GenAI
category: samples
GenAI samples
category: sampling
Sampling / Decoding algorithms
category: speculative decoding
Speculative decoding
category: text to image
Text 2 image pipeline
category: tokenizers
Tokenizer class or submodule update
category: visual language
Visual language pipeline
category: whisper
Whisper pipeline
no-match-files
[GenAI tools] Updated testing models
category: GHA
CI based on Github actions
category: text to image
Text 2 image pipeline
category: WWB
PR changes WWB
[Testing] SDPA vs PA: debug prints
category: continuous batching
Continuous batching
category: LLM
LLM pipeline (stateful, static)
category: sampling
Sampling / Decoding algorithms
do_not_merge
do_not_review
no-match-files
Pl bench
category: cmake / build
Cmake scripts
category: continuous batching
Continuous batching
category: GenAI C++ API
Changes in GenAI C++ public headers
category: GHA
CI based on Github actions
category: LLM
LLM pipeline (stateful, static)
category: Python API
Python API for GenAI
category: samples
GenAI samples
category: sampling
Sampling / Decoding algorithms
category: speculative decoding
Speculative decoding
no-match-files
Use get_max_new_tokens() insted of max_new_tokens field when stopping…
category: sampling
Sampling / Decoding algorithms
#1417
opened Dec 20, 2024 by
michalkulakowski
Loading…
add performance statistics for image generation
category: cmake / build
Cmake scripts
category: GenAI C++ API
Changes in GenAI C++ public headers
category: Python API
Python API for GenAI
category: samples
GenAI samples
category: text to image
Text 2 image pipeline
#1405
opened Dec 18, 2024 by
xufang-lisa
•
Draft
Add performance statistics for speculative decoding test
category: continuous batching
Continuous batching
category: prompt lookup
category: samples
GenAI samples
category: speculative decoding
Speculative decoding
#1403
opened Dec 18, 2024 by
xufang-lisa
•
Draft
Cross referencing blogs in genai samples readme
category: samples
GenAI samples
#1399
opened Dec 17, 2024 by
DimaPastushenkov
Loading…
[GHA] Samples tests
category: cmake / build
Cmake scripts
category: GHA
CI based on Github actions
no-match-files
[CB]Support 4-bit cache
category: continuous batching
Continuous batching
do_not_merge
#1366
opened Dec 12, 2024 by
zhangYiIntel
•
Draft
Previous Next
ProTip!
Type g i on any issue or pull request to go back to the issue listing page.