zach
/
RA.Aid
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity

FIX removed --disable-thinking flag because we have the skip sonnet flag

This commit is contained in:
Jose Leon 2025-03-11 02:37:37 +00:00
parent 36678969a9
commit 9f3e6b9ae8
2 changed files with 8 additions and 12 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

19
docs/docs/configuration/thinking-models.md
View File

@ -135,17 +135,12 @@ When this flag is used, RA.Aid will not automatically disable thinking mode when
### Manually Disabling Thinking Mode ### Manually Disabling Thinking Mode
You can also choose to disable thinking mode from the start using the `--disable-thinking` flag: When the automatic workaround is applied, thinking mode is disabled for the current session. If you want to disable thinking mode from the start of a session, you can simply use a model that doesn't support thinking mode, such as Claude 3.5 Sonnet.
```bash This approach:
ra-aid -m "Debug the database connection issue" --provider anthropic --model claude-3-7-sonnet-20250219 --disable-thinking - Prevents the thinking mode from being activated
``` - Makes the model operate in standard mode without the structured thinking blocks
- Avoids the API errors that can occur with thinking mode enabled
When this option is enabled:
- The thinking mode will not be activated for Claude 3.7 models
- The model will operate in standard mode without the structured thinking blocks
- This can help avoid certain API errors that might occur with thinking mode enabled
### When to Disable Thinking Mode ### When to Disable Thinking Mode
@ -177,8 +172,8 @@ Unretryable API error: Error code: 400 - {'type': 'error', 'error': {'type': 'in
This is related to the thinking mode format requirements. You can: This is related to the thinking mode format requirements. You can:
- Use the `--disable-thinking` flag to turn off thinking mode - Use a model that doesn't support thinking mode, such as Claude 3.5 Sonnet
- Upgrade to the latest version of RA.Aid which includes fixes for these errors - Upgrade to the latest version of RA.Aid which includes the automatic workaround for these errors
- For long-running sessions, consider restarting the assistant periodically - For long-running sessions, consider restarting the assistant periodically
#### Excessive or irrelevant thinking #### Excessive or irrelevant thinking

1
ra_aid/llm.py
View File

@ -259,6 +259,7 @@ def create_llm_client(
else: else:
temp_kwargs = {} temp_kwargs = {}
# Enable thinking mode for models that support it, unless it's been disabled by the automatic workaround
if supports_thinking and not config.get("disable_thinking", False): if supports_thinking and not config.get("disable_thinking", False):
temp_kwargs = {"thinking": {"type": "enabled", "budget_tokens": 12000}} temp_kwargs = {"thinking": {"type": "enabled", "budget_tokens": 12000}}