OpenAI

Connect your OpenAI-powered application to Latitude Telemetry for feature-level observability and evaluations.

Overview

This guide shows you how to integrate Latitude Telemetry into an existing application that uses the official OpenAI SDK.

After completing these steps:

• Every OpenAI call (e.g. chat.completions.create) can be captured as a log in Latitude.
• Logs are grouped under a prompt, identified by a path, inside a Latitude project.
• You can inspect inputs/outputs, measure latency, and debug OpenAI-powered features from the Latitude dashboard.

You’ll keep calling OpenAI exactly as you do today — Telemetry simply observes and enriches those calls.

---

Requirements

Before you start, make sure you have:

• A Latitude account and API key
• A Latitude project ID
• A Node.js-based project that uses the OpenAI SDK

That’s it — prompts do not need to be created ahead of time.

---

Steps

1. Install requirements

   Add the Latitude Telemetry package to your project:

   npm

   npm add @latitude-data/telemetry
   
2. Initialize Latitude Telemetry

   Create a single LatitudeTelemetry instance when your app starts

   You must pass the OpenAI SDK so Telemetry can instrument it.

   telemetry.ts

   import { LatitudeTelemetry } from '@latitude-data/telemetry'
   import OpenAI from 'openai'
   
   export const telemetry = new LatitudeTelemetry(
     process.env.LATITUDE_API_KEY,
     {
       instrumentations: {
         openai: OpenAI, // This enables automatic tracing for the OpenAI SDK
       },
     }
   )
   

   The Telemetry instance should only be created once. Any OpenAI client instantiated after this will be automatically traced.

3. Wrap your OpenAI-powered feature

   Wrap the code that calls OpenAI using telemetry.capture.

   import { telemetry } from './telemetry'
   import OpenAI from 'openai'
   
   export async function generateSupportReply(input: string) {
     return telemetry.capture(
       {
         projectId: 123, // The ID of your project in Latitude
         path: 'generate-support-reply', // Add a path to identify this prompt in Latitude
       },
       async () => {
   
         // Your regular LLM-powered feature code here
         const client = new OpenAI();
         const completion = await client.chat.completions.create({ ... })
   
         // You can return anything you want — the value is passed through unchanged
         return completion.choices[0].message.content
       }
     )
   }
   

   The path:

   • Identifies the prompt in Latitude
   • Can be new or existing
   • Should not contain spaces or special characters (use letters, numbers, - _ / .)

---

Seeing your logs in Latitude

Once your feature is wrapped, logs will appear automatically.

1. Open the prompt in your Latitude dashboard (identified by path)
2. Go to the Traces section
3. Each execution will show:
   • Input and output messages
   • Model and token usage
   • Latency and errors
   • One trace per feature invocation

Each OpenAI call appears as a child span under the captured prompt execution, giving you a full, end-to-end view of what happened.

---

That’s it

No changes to your OpenAI calls, no special return values, and no extra plumbing — just wrap the feature you want to observe.