Run subgraphs with model inputs

[ericcraw]

Description

Run subgraphs with model inputs.

Motivation and Context

Subgraphs with model inputs were omitted for an unknown reason. Including them improves performance for key use cases.

[preetha-intel]

LGTM

[sfatimar]

@ericcraw can you test this issue with multiple ORT Optimization levels @vthaniel can we run a perf regression test with this fix.

[ericcraw]

@ericcraw can you test this issue with multiple ORT Optimization levels @vthaniel can we run a perf regression test with this fix.

The currently supported usage of OVEP is to run with optimization disabled. General question: why would we test/support any other optimization level? We should be clear on what configuration is supported and stick to it no?

Regardless, I have run with highest optimization for this particular use case with model proxies, and it runs with slightly lower performance but is seemingly accurate (as determined by just eyeballing the output).

[sfatimar]

@ericcraw can you test this issue with multiple ORT Optimization levels @vthaniel can we run a perf regression test with this fix.

The currently supported usage of OVEP is to run with optimization disabled. General question: why would we test/support any other optimization level? We should be clear on what configuration is supported and stick to it no?
MSFT has requested graphs to be enabled for all optimization levels
Regardless, I have run with highest optimization for this particular use case with model proxies, and it runs with slightly lower performance but is seemingly accurate (as determined by just eyeballing the output).

[ericcraw]

@sfatimar/@vthaniel is there an ETA for merge? or anything to be done to accelerate this?

[sfatimar]

@sfatimar/@vthaniel is there an ETA for merge? or anything to be done to accelerate this?

Please track this through the new Pull Request #532