Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Added deployment cache #53

Draft
wants to merge 10 commits into
base: main
Choose a base branch
from
Draft

Added deployment cache #53

wants to merge 10 commits into from

Conversation

CharlesDuboisSAP
Copy link
Contributor

@CharlesDuboisSAP CharlesDuboisSAP commented Sep 6, 2024 •
edited
Loading

Context

AI/ai-sdk-java-backlog#54.

The lookup of deployments should be more efficient & resilient.

Feature scope:

  • Filter for Orchestration and OpenAI deployments
  • Cache for deployments
    • Initialized eagerly
    • No timeout

Definition of Done

  • Functionality scope stated & covered
  • Tests cover the scope above
  • Error handling created / updated & covered by the tests above
  • Aligned changes with the JavaScript SDK
  • Documentation updated
  • Release notes updated

@CharlesDuboisSAP CharlesDuboisSAP self-assigned this Sep 6, 2024
@CharlesDuboisSAP CharlesDuboisSAP changed the title Added query filters for Orchestration and OpenAI deployments Added deployment cache Sep 6, 2024
@CharlesDuboisSAP CharlesDuboisSAP marked this pull request as draft September 18, 2024 10:42
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees

@CharlesDuboisSAP CharlesDuboisSAP

Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
1 participant
@CharlesDuboisSAP