You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
Commit dd89a8e
Browse filesBrowse the repository at this point in the historyBrowse files
## Motivation and Context (Why the change? What's the scenario?)
Adds a new TokenUsage property to MemoryAnswer to hold information about token usage.
## High level description (Approach, Design)
* Include token count provided by the internal tokenizer
* Include token count provided by the service, if available
* Support streaming and multiple services, if needed
---------
Co-authored-by: Devis Lucato <dluc@users.noreply.github.com>
0 commit comments