360Labs.dev()
0%
Back to Portfolio
Promptctl
Web|Live

Promptctl

The definitive CLI for Prompt Engineering as Code - develop, test, and monitor LLM prompts with software engineering rigor.

Overview

Promptctl is a CLI that brings software engineering best practices to LLM development.

Specs

CoreCLI for prompt versioning, testing, and A/B evaluation
PromptsMarkdown files with YAML frontmatter, version controlled
TestingJSON test cases with exact match, regex, semantic similarity, JSON schema
StackTypeScript, Node.js, React, Vite, Express
ProvidersGoogle Gemini (1.5-3.0), OpenAI, Anthropic, local models

Features

  • Prompts as Code - Markdown with YAML frontmatter
  • Test-Driven Development with JSON test cases
  • Bulk evaluation with pass/fail rates and latency metrics
  • A/B testing with 95% confidence intervals
  • Local React dashboard for history and cost analysis
  • Multi-provider support: Gemini, OpenAI, Anthropic

Tech Stack

TypeScriptNode.jsReactGoogle GenAI

Interested in Promptctl?

Let's discuss how this can work for you.

Get in Touch