Google Gemini
The Google Gemini provider (GenAI) supports Gemini 1.5 Pro, Flash, and Gemini 2.0 models.
1. Setup & Authentication
Set the GOOGLE_API_KEY environment variable.
export GOOGLE_API_KEY='your-api-key-here'2. Basic Usage
import ( "context" "github.com/masterkeysrd/loom/llm" "github.com/masterkeysrd/loom/providers/genai")
ctx := context.Background()provider, err := loomgenai.NewDefaultProvider(ctx)if err != nil { // handle error}
model, err := llm.NewModel(provider, "gemini-1.5-pro", nil)if err != nil { log.Fatal(err)}Note. Providers created through
NewProvider/NewDefaultProviderpin requests to thev1betaAPI unlessHTTPOptions.APIVersionis set explicitly. This keeps-latestmodel aliases (such asgemini-flash-lite-latest) working, since the Google GenAI SDK defaults API-key clients tov1from v1.78.0 onward. Vertex AI clients keep the SDK default when no version is set.
3. Advanced Features
Reasoning
Configure thinking levels for models that support it.
model = model.WithThinking(2000)Context Caching
Google Gemini supports long-lived context caches for large datasets or documents. Unlike Anthropic’s implicit markers, Gemini caches must be explicitly created and referenced by ID.
1. Creating a Cache
You can use model.CreateCache to upload content and get a cache ID.
cacheID, _ := model. WithExtension(loomgenai.CacheCreation{ DisplayName: "Project Docs", TTL: 1 * time.Hour, }). CreateCache(ctx, documentMessages)2. Using the Cache
Pass the ID back using the ContextCache extension.
resp, _ := model.Invoke(ctx, prompt, llm.WithExtensionOption(loomgenai.ContextCache{ID: cacheID}))3. Deleting the Cache
It is good practice to delete the cache when finished to save on costs.
model.DeleteCache(ctx, cacheID)4. Model Profiles & Live Discovery
Google GenAI models are statically defined with multimodal support, context window sizes, and tiered pricing, and the provider also implements llm.ModelLister against the Gemini models.list and models.get endpoints:
// 1. Search static profilesprofiles := provider.SearchProfiles("gemini-2.5")
// 2. Live API discovery (normalizes "models/..." prefixes, preserves static pricing,// and discovers tunedModels/... or newly released models)models, err := provider.ListModels(ctx)prof, err := provider.GetModel(ctx, "gemini-2.5-pro")5. Embedding Models 🧭
loomgenai.Provider implements the embedding.Provider interface, supporting both text and multimodal embeddings (such as gemini-embedding-001 and gemini-embedding-2), task-type optimization, and configurable output dimensionality:
import ( "context" "fmt" "log"
"github.com/masterkeysrd/loom/embedding" loomgenai "github.com/masterkeysrd/loom/providers/genai")
ctx := context.Background()provider, err := loomgenai.NewDefaultProvider(ctx)if err != nil { log.Fatal(err)}
embedModel, err := embedding.NewModel(provider, "gemini-embedding-001", nil)if err != nil { log.Fatal(err)}
vec, err := embedModel. WithDimensions(768). EmbedQuery(ctx, "What are the key capabilities of Gemini?")if err != nil { log.Fatal(err)}fmt.Printf("Vector dimensions: %d\n", vec.Dimension())