Skip to content

Agency with observability

Prompty is a new asset class and format for LLM prompts that aims to provide observability, understandability, and portability for developers.

What is Prompty?

What is Prompty?

Prompty is an asset class and format for LLM prompts that aims to provide observability, understandability, and portability for developers - the primary goal is to speed up the developer inner loop.

Prompty is comprised of 3 things

  • the specification,
  • its tooling,
  • and runtime.

The specification

The specification

Prompty is intended to be a language agnostic asset class for creating and managing prompts.

  • Uses common markdown format
  • Modified front-matter to specify metadata, model settings, sample data (among other things)
  • Content in a standard template format

The tooling

The tooling

Given the standard specification, there’s a lot of nice things we can give developers in their environment.

  • Front matter autocompletion
  • Colorization / syntax highlighting
  • Validation (with red squiggles for undefined variables)
  • Quick run
  • Code generation
  • Evaluation generation

The runtime

The runtime

Prompty runtime is the whatever engine that understands and can execute the format. As a standalone file, it can’t really do anything without the help of the extension (when developing) or the runtime (when running).

  • Works in Python
  • Works in C#
  • (In progress) works in TypeScript/JavaScript
1

Feel confident while building

Understand what’s coming in and going out and how to manage it effectively.

2

Language agnostic

Use with any language or framework you are familiar with.

3

Flexible and simple

Integrate into whatever development environments or workflows you have.

Standards open doors

Standards open doors

By working in a common format we open up opportunities for new improvements.

  • By default all prompty executions will produce tracing for each prompty called
  • Developers can add additional tracing via simple SDK functions
  • Tracing output uses OpenTelemetry so any/all existing tooling around that standard can be used to visualize the tracing output.

Works for everyone

Works for everyone

Prompty is built on the premise that even with increasing complexity in AI, a fundamental unit remains prompts. And understanding this can lead to more innovative developments in AI applications, for everyone.