chore: GenAI Client(evals) - Add class methods for parsing raw Agent Session history into the new AgentData structure. Add agent_resource_name attribute to AgentConfig and loading methods.#6347
Open
copybara-service[bot] wants to merge 1 commit intomainfrom
Conversation
product-auto-label
bot
added
size: l
copybara-service
bot
force-pushed
the
copybara_869945268
branch
from
565482a to
cc1b241
Compare
copybara-service
bot
changed the title
AgentData structureAgentData structure. Add agent_resource_name attribute to AgentConfig and loading methods.
product-auto-label
bot
added
size: m
copybara-service
bot
force-pushed
the
copybara_869945268
branch
from
cc1b241 to
d3ab8bc
Compare
…Session history into the new `AgentData` structure. Add `agent_resource_name` attribute to `AgentConfig` and loading methods. feat: GenAI Client(evals) - Add 3 new multi-turn predefined metrics for agent evaluation (`MULTI_TURN_TOOL_USE_QUALITY`, `MULTI_TURN_TRAJECTORY_QUALITY`, `MULTI_TURN_TASK_SUCCESS`). chore: GenAI Client(evals) - Update evaluation data converters and metric handlers to natively support `AgentData` in `EvaluationDataset` and `EvalCase`. chore: GenAI Client(evals) - Map `agent_data` to `agent_eval_data` in Vertex REST payload generation. PiperOrigin-RevId: 869945268
copybara-service
bot
force-pushed
the
copybara_869945268
branch
from
d3ab8bc to
dbe80fd
Compare
copybara-service
bot
changed the title
AgentData structure. Add agent_resource_name attribute to AgentConfig and loading methods.AgentData structure. Add agent_resource_name attribute to AgentConfig and loading methods.
product-auto-label
bot
added
size: l
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
chore: GenAI Client(evals) - Add class methods for parsing raw Agent Session history into the new
AgentDatastructure. Addagent_resource_nameattribute toAgentConfigand loading methods.feat: GenAI Client(evals) - Add 3 new multi-turn predefined metrics for agent evaluation (
MULTI_TURN_TOOL_USE_QUALITY,MULTI_TURN_TRAJECTORY_QUALITY,MULTI_TURN_TASK_SUCCESS).chore: GenAI Client(evals) - Update evaluation data converters and metric handlers to natively support
AgentDatainEvaluationDatasetandEvalCase.chore: GenAI Client(evals) - Map
agent_datatoagent_eval_datain Vertex REST payload generation.