Skip to content

Support runtime configuration #8272

@GregoryComer

Description

@GregoryComer

🚀 The feature, motivation and pitch

We need a method for the user to pass in runtime configuration options, especially to specific delegates, but potentially to the core runtime as well. Motivating use cases include enabling/disabling workspace sharing or weight caching in the XNNPACK delegate. Ideally we would be able to expose both global and per-model configurations. @dbort has an older proposal for runtime configuration APIs that we can likely iterate on and implement.

Alternatives

No response

Additional context

No response

RFC (Optional)

No response

cc @JacobSzwejbka @dbort

Metadata

Metadata

Assignees

No one assigned

    Labels

    module: runtimeIssues related to the core runtime and code under runtime/triagedThis issue has been looked at a team member, and triaged and prioritized into an appropriate module

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions