Subject: Feature Request: Dynamic LLM Routing with Free Tier Optimization (e.g., Claude)

Description:

I am requesting a feature that allows for dynamic routing of LLM calls made via base44.integrations.Core.InvokeLLM, specifically to optimize usage of free tiers offered by various LLM providers.

Currently, the platform automatically handles LLM selection, and there's no user-configurable option to prioritize models or utilize free tiers until their limits are reached. For example, some models like Anthropic's Claude offer daily free usage limits.

Proposed Functionality:

I would like to be able to configure Base44 to:

1. Prioritize LLMs with Free Tiers: Route InvokeLLM requests to a specified LLM (e.g., Claude) first, as long as its daily/monthly free usage limit has not been exhausted.

2. Automatic Fallback: Once the free tier limit for the prioritized LLM is reached, automatically switch to a secondary, user-defined default LLM or another configured LLM.

3. Visibility/Configuration: Provide settings within the Base44 dashboard or as parameters to InvokeLLM to:

   • Specify preferred LLMs for free-tier routing.

   • Define fallback LLMs.

   • Monitor current free tier usage and limits.

Benefits:

• Cost Optimization: Significantly reduce LLM costs by leveraging free usage allowances.

• Flexibility: Allow users to take advantage of different LLM capabilities without incurring immediate costs for preferred models.

• Enhanced User Control: Give developers more control over LLM usage strategies beyond simple default selection.

Thank you for considering this feature request.