FIX removed --disable-thinking flag because we have the skip sonnet flag

This commit is contained in:
Jose Leon 2025-03-11 02:37:37 +00:00
parent 36678969a9
commit 9f3e6b9ae8
2 changed files with 8 additions and 12 deletions

View File

@ -135,17 +135,12 @@ When this flag is used, RA.Aid will not automatically disable thinking mode when
### Manually Disabling Thinking Mode
You can also choose to disable thinking mode from the start using the `--disable-thinking` flag:
When the automatic workaround is applied, thinking mode is disabled for the current session. If you want to disable thinking mode from the start of a session, you can simply use a model that doesn't support thinking mode, such as Claude 3.5 Sonnet.
```bash
ra-aid -m "Debug the database connection issue" --provider anthropic --model claude-3-7-sonnet-20250219 --disable-thinking
```
When this option is enabled:
- The thinking mode will not be activated for Claude 3.7 models
- The model will operate in standard mode without the structured thinking blocks
- This can help avoid certain API errors that might occur with thinking mode enabled
This approach:
- Prevents the thinking mode from being activated
- Makes the model operate in standard mode without the structured thinking blocks
- Avoids the API errors that can occur with thinking mode enabled
### When to Disable Thinking Mode
@ -177,8 +172,8 @@ Unretryable API error: Error code: 400 - {'type': 'error', 'error': {'type': 'in
This is related to the thinking mode format requirements. You can:
- Use the `--disable-thinking` flag to turn off thinking mode
- Upgrade to the latest version of RA.Aid which includes fixes for these errors
- Use a model that doesn't support thinking mode, such as Claude 3.5 Sonnet
- Upgrade to the latest version of RA.Aid which includes the automatic workaround for these errors
- For long-running sessions, consider restarting the assistant periodically
#### Excessive or irrelevant thinking

View File

@ -259,6 +259,7 @@ def create_llm_client(
else:
temp_kwargs = {}
# Enable thinking mode for models that support it, unless it's been disabled by the automatic workaround
if supports_thinking and not config.get("disable_thinking", False):
temp_kwargs = {"thinking": {"type": "enabled", "budget_tokens": 12000}}