feat: AI wrapper for AWS Bedrock and GCP Garden integration

[dkargatzis]

Overview

Create an abstraction layer (AI wrapper) that enables teams to easily utilize large language models and other AI services via AWS Bedrock or GCP Garden, allowing for flexible backend selection and seamless integration into our existing workflows.

Motivation

• Multi-cloud flexibility: Teams may have preferences or requirements to use either AWS Bedrock or GCP Garden for AI/ML workloads.
• Unified interface: A common API/wrapper will reduce code duplication and make it easier to switch between providers.
• Future extensibility: Lays the groundwork for supporting additional AI providers in the future.

Requirements

• Design a common interface for AI model invocation (e.g., text generation, embeddings, etc.).
• Implement provider-specific adapters for AWS Bedrock and GCP Garden.
• Allow configuration to select the desired backend at runtime or via environment/config files.
• Provide clear error handling and logging for unsupported features or provider-specific issues.
• Include documentation and usage examples for both providers.

Acceptance Criteria

• Teams can switch between AWS Bedrock and GCP Garden with minimal code changes.
• The wrapper supports at least basic text generation for both providers.
• Configuration is straightforward and well-documented.
• Unit/integration tests cover both backends.

Additional Context

• AWS Bedrock documentation
• GCP Garden documentation

[aryanraj2713]

@dkargatzis can I work on this?

[dkargatzis]

@dkargatzis can I work on this?

@aryanraj2713 Sure, go ahead!

[aryanraj2713]

@dkargatzis I tested OpenAI , need help with bedrock and GCP , followed docs, but don't have credits/account

[dkargatzis]

@aryanraj2713 this was super fast! Happy to test it together using our account / credits.

This is my email if you want me to jump on a call and test it together dimitris.kargatzis@warestack.com - otherwise I'll proceed with the PR review and testing and give you my feedback!

[aryanraj2713]

You can test it for now and let me know if any fixes or refactoring is required, I will try to get a knowledge transfer from you for the codebase as I want to contribute more.

[dkargatzis]

@aryanraj2713 Great leave it on me - I can apply any fixes in your PR if needed. Welcome abroad, looking forward to your next contribution!