Skip to content

Latitude is the open-source prompt engineering platform to build, evaluate, and refine your prompts with AI

License

Notifications You must be signed in to change notification settings

latitude-dev/latitude-llm

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation


The Open-Source Prompt Engineering Platform


See documentation →

Join Our Slack · X

🌈 Why Latitude?

Latitude is an open-source platform for AI prompt engineering, deployment, and evaluation. It helps teams build, test, and maintain reliable AI applications by providing a complete lifecycle management system for prompts.

With Latitude, you can:

  • Design and version prompts collaboratively
  • Test iterations in an interactive playground
  • Deploy prompts as API endpoints
  • Monitor performance with automatic logging
  • Evaluate and improve prompts systematically

Latitude is designed for cross-functional teams, enabling collaboration between developers, product managers, and domain experts throughout the entire AI development process.

Latitude screenshot

✨ Features

  • Prompt Manager: Create, version, and collaborate on prompts with a powerful editor supporting advanced features like variables, conditionals, and loops through PromptL
  • Playground: Test prompts interactively with different inputs, parameters, and tool configurations
  • AI Gateway: Deploy prompts as API endpoints that stay up-to-date with published changes
  • Evaluations: Assess prompt performance via LLM-as-judge, programmatic rules, or human review
  • Logs & Observability: Automatically capture all interactions with prompts and models
  • Datasets: Manage test data for batch evaluations and regression testing
  • Integrations: Seamlessly integrate with your existing stack via SDKs and APIs
  • Open-source: Driven by the community

📚 Table Of Contents

⚡ Quick start

Latitude offers two deployment options:

  1. Latitude Cloud: A fully managed solution that allows you to get started quickly without worrying about infrastructure.
  2. Latitude Self-Hosted: An open-source version that you can deploy and manage on your own infrastructure for complete control and customization.

Choose the option that best fits your needs and follow the corresponding instructions below.

Latitude Cloud

To get started with Latitude, follow these steps:

  1. Sign up for Latitude: Visit our website and follow the instructions to create your account.

  2. Create a new project: Once logged in, create a new project to organize your prompts and evaluations.

  3. Write your first prompt: Navigate to the Editor and create a new prompt. Start with a simple task, like generating a short story or answering a question.

  4. Test your prompt: Use the playground to test your prompt with different inputs and see the model's responses.

  5. Evaluate in batch: Before deploying, you can upload a dataset and run a batch evaluation to assess your prompt's performance across various scenarios.

  6. Deploy your prompt: Once you're satisfied with your prompt's performance in batch evaluation, deploy it as an endpoint for easy integration with your applications.

  7. Monitor and evaluate: Use the Logs section to review your prompt's performance over time. Set up ongoing evaluations to systematically assess and improve your prompt's output.

  8. Iterate and improve: Based on the evaluation results, refine your prompt or create new versions to enhance its performance.

  9. Collaborate with your team: Invite team members to your Latitude workspace to collaborate on prompt engineering and evaluations.

For more detailed information on each step, explore our documentation or join our community for support and discussions.

Latitude Self-Hosted

Follow the instructions in the self-hosted guide to get started with Latitude Self-Hosted.

After setting up Latitude Self-Hosted, you can follow the same steps as in the Latitude Cloud guide to create, test, evaluate, and deploy your prompts.

👥 Community

The Latitude community can be found on Slack where you can ask questions, voice ideas, and share your projects with other people.

🤝 Contributing

Contributions to Latitude are welcome and highly appreciated.

If you are interested in contributing, please join us on our Slack community, open an issue, or contribute a pull request.

📄 License

Latitude is licensed under the LGPL-3.0.

Alternatively, we offer a more permissive commercial license for those who need it. Please contact us at [email protected] for more information.

🔗 Links