-
Notifications
You must be signed in to change notification settings - Fork 61
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Fix azure client Add new client paramters: allowed_roles, default_role, finish_reason_allow_list, finish_reason_deny_list #1209
Conversation
The latest updates on your projects. Learn more about Vercel for Git ↗︎
|
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
👍 Looks good to me! Reviewed everything up to 8b20396 in 1 minute and 16 seconds
More details
- Looked at
2686
lines of code in38
files - Skipped
0
files when reviewing. - Skipped posting
1
drafted comments based on config settings.
1. typescript/playground-common/src/baml_wasm_web/test_uis/test_result.tsx:58
- Draft comment:
Add a filter button for 'Finish Reason Failed' to maintain consistency with other test statuses.
<FilterButton
selected={filter.has('finish_reason_failed')}
name='Finish Reason Failed'
count={statusCounts.done.finish_reason_failed}
onClick={() => toggleFilter('finish_reason_failed')}
/>
- Reason this comment was not posted:
Comment was on unchanged code.
Workflow ID: wflow_kqODY7jE0XvTefys
You can customize Ellipsis with 👍 / 👎 feedback, review rules, user-specific overrides, quiet
mode, and more.
Add new client paramters: allowed_roles, default_role, finish_reason_allow_list, finish_reason_deny_list TODO: add more tests, but screenshots show it working
8b20396
to
aa6d118
Compare
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
👍 Looks good to me! Incremental review on aa6d118 in 22 seconds
More details
- Looked at
18
lines of code in1
files - Skipped
0
files when reviewing. - Skipped posting
0
drafted comments based on config settings.
Workflow ID: wflow_Bjvo46lfC84P1WT4
You can customize Ellipsis with 👍 / 👎 feedback, review rules, user-specific overrides, quiet
mode, and more.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
👍 Looks good to me! Incremental review on 7732f8b in 1 minute and 1 seconds
More details
- Looked at
544
lines of code in11
files - Skipped
0
files when reviewing. - Skipped posting
5
drafted comments based on config settings.
1. engine/baml-lib/jinja-runtime/src/lib.rs:246
- Draft comment:
Inconsistent usage ofallowed_roles
. Consider using a consistent approach to accessallowed_roles
across the codebase to avoid confusion and potential bugs. - Reason this comment was not posted:
Confidence changes required:50%
The PR introduces a new parameterallowed_roles
in multiple files, but the usage of this parameter is inconsistent. In some places, it is used directly, while in others, it is accessed through a method. This inconsistency can lead to confusion and potential bugs.
2. engine/baml-lib/llm-client/src/clients/anthropic.rs:66
- Draft comment:
Inconsistent usage ofallowed_roles
. Consider using a consistent approach to accessallowed_roles
across the codebase to avoid confusion and potential bugs. - Reason this comment was not posted:
Confidence changes required:50%
The PR introduces a new parameterallowed_roles
in multiple files, but the usage of this parameter is inconsistent. In some places, it is used directly, while in others, it is accessed through a method. This inconsistency can lead to confusion and potential bugs.
3. engine/baml-lib/llm-client/src/clients/aws_bedrock.rs:81
- Draft comment:
Inconsistent usage ofallowed_roles
. Consider using a consistent approach to accessallowed_roles
across the codebase to avoid confusion and potential bugs. - Reason this comment was not posted:
Confidence changes required:50%
The PR introduces a new parameterallowed_roles
in multiple files, but the usage of this parameter is inconsistent. In some places, it is used directly, while in others, it is accessed through a method. This inconsistency can lead to confusion and potential bugs.
4. engine/baml-lib/llm-client/src/clients/google_ai.rs:72
- Draft comment:
Inconsistent usage ofallowed_roles
. Consider using a consistent approach to accessallowed_roles
across the codebase to avoid confusion and potential bugs. - Reason this comment was not posted:
Confidence changes required:50%
The PR introduces a new parameterallowed_roles
in multiple files, but the usage of this parameter is inconsistent. In some places, it is used directly, while in others, it is accessed through a method. This inconsistency can lead to confusion and potential bugs.
5. engine/baml-lib/llm-client/src/clients/vertex.rs:152
- Draft comment:
Inconsistent usage ofallowed_roles
. Consider using a consistent approach to accessallowed_roles
across the codebase to avoid confusion and potential bugs. - Reason this comment was not posted:
Confidence changes required:50%
The PR introduces a new parameterallowed_roles
in multiple files, but the usage of this parameter is inconsistent. In some places, it is used directly, while in others, it is accessed through a method. This inconsistency can lead to confusion and potential bugs.
Workflow ID: wflow_2wt735gToeb23n6M
You can customize Ellipsis with 👍 / 👎 feedback, review rules, user-specific overrides, quiet
mode, and more.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
👍 Looks good to me! Incremental review on 2039f19 in 22 seconds
More details
- Looked at
114
lines of code in1
files - Skipped
0
files when reviewing. - Skipped posting
1
drafted comments based on config settings.
1. engine/baml-lib/jinja-runtime/src/lib.rs:1118
- Draft comment:
Consider adding a test case to verify that when a role is not in the allowed roles, it defaults to the default role. This will ensure the role fallback mechanism works as expected. - Reason this comment was not posted:
Confidence changes required:50%
The testrender_with_kwargs_default_role
is missing a check for the role fallback mechanism. It should verify that when a role is not in the allowed roles, it defaults to the default role.
Workflow ID: wflow_ApS04GJytR4B1lGo
You can customize Ellipsis with 👍 / 👎 feedback, review rules, user-specific overrides, quiet
mode, and more.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
❌ Changes requested. Incremental review on 0fe2c37 in 57 seconds
More details
- Looked at
173
lines of code in4
files - Skipped
0
files when reviewing. - Skipped posting
1
drafted comments based on config settings.
1. engine/language_client_typescript/index.js:86
- Draft comment:
Consider returning the original error instead ofundefined
if parsing fails in thefrom
method. This ensures the error is not lost and can be handled appropriately. - Reason this comment was not posted:
Marked as duplicate.
Workflow ID: wflow_55jfIiT0O62Hj2EC
Want Ellipsis to fix these issues? Tag @ellipsis-dev
in a comment. You can customize Ellipsis with 👍 / 👎 feedback, review rules, user-specific overrides, quiet
mode, and more.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
👍 Looks good to me! Incremental review on 8652179 in 29 seconds
More details
- Looked at
105
lines of code in1
files - Skipped
0
files when reviewing. - Skipped posting
1
drafted comments based on config settings.
1. engine/baml-lib/llm-client/src/clients/helpers.rs:199
- Draft comment:
The functionensure_default_role
is defined twice. Remove the redundant definition to avoid confusion. - Reason this comment was not posted:
Comment was on unchanged code.
Workflow ID: wflow_N6EyTEkGhAvk3zIb
You can customize Ellipsis with 👍 / 👎 feedback, review rules, user-specific overrides, quiet
mode, and more.
TODO: add more tests, but screenshots show it working
Important
This PR adds role selection and finish reason filtering to clients, updates error handling, and modifies tests for new parameters.
role_selection
andfinish_reason_filter
parameters to clients inanthropic.rs
,aws_bedrock.rs
, andgoogle_ai.rs
.allowed_roles()
anddefault_role()
methods for role selection.finish_reason_filter
to manage finish reasons.FinishReasonError
inerrors.rs
for Python and TypeScript clients.internal_monkeypatch.py
anderrors.rs
for Python.errors.rs
for TypeScript.test_cli.rs
,test_runtime.rs
, andtest_file_manager.rs
for new parameters.harness.rs
for new client parameters.log-once
dependency inCargo.toml
andCargo.lock
.README.md
and logging inapp.py
.This description was created by for 8652179. It will automatically update as commits are pushed.