Skip to content

Trim a11.txt to first ~11k tokens to avoid CI rate limits - #119

Closed
katlyn-edwards wants to merge 1 commit into
google-gemini:mainfrom
katlyn-edwards:smaller-cache-transcript
Closed

katlyn-edwards wants to merge 1 commit into
google-gemini:mainfrom
katlyn-edwards:smaller-cache-transcript

Conversation

@katlyn-edwards

Copy link
Copy Markdown
Collaborator

The caching and count-tokens examples used the full Apollo 11 transcript (~322k tokens), far above the 1,024-token caching minimum. Running these tests exceeded the per-minute input-token quota and CI failed with 429s.

Keep the first ~30KB (~11k tokens): launch through TLI, transposition and docking, which covers every prompt the examples use.

The caching and count-tokens examples used the full Apollo 11 transcript
(~322k tokens), far above the 1,024-token caching minimum. Running these
tests exceeded the per-minute input-token quota and CI failed with 429s.

Keep the first ~30KB (~11k tokens): launch through TLI, transposition
and docking, which covers every prompt the examples use.
@gemini-code-assist

Copy link
Copy Markdown
Contributor

Note

Gemini is unable to generate a review for this pull request due to the file types involved not being currently supported.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant