My open source work

promptfoo is a CLI & package for setting up evals & testing LLM outputs.

QuickChart is an API for rendering chart images and QR codes. I host it as a free web service that generates 60 million charts per month.

Spacekit is a Javascript library for building science-based 3D space visualizations. It's used in many popular open source projects of mine, which in turn are used in school curricula and by media to help teach science:

• Ancient Earth - see 750M years of Earth's history (7.2M visits since creation)
• Meteor Showers - understand how meteor showers work (2.7M visits since creation)
• Asterank - go-to reference for asteroid mining info! (nearly 1M visitors)

Textbelt is an API for outgoing SMS. I've built an open-source version that uses email-to-SMS gateways so people can send SMS for free.

The CA Property Tax Map project is a map that visualizes the effects of Prop 13 by scraping residential and commercial real estate taxes from California counties.

I also publish a handful of helper libraries such as j2000 (date conversion tool for astronomical calculations) and gmaps-url-signer.

The plan for Promptfoo

• Provide a great open-source entrypoint for LLM evaluation, prompt testing, and basic LLM Ops
• Increase public understanding of the importance of structured, iterative, and evidence-based prompt "engineering"

The plan for QuickChart

• Improve stability and extend testing
• Add new rendering capabilities (e.g. math formulas, more advanced PDF layout, Apex charts(?), Google Image Charts compatible syntax)
• Expand the free tier (which is already pretty generous)
• Continue to provide support for self-hosted deployments

The plan for Spacekit

• Make Spacekit visualizations more immersive and flexible: e.g. add a tweening system to enable scripted movement between objects, raytracing to occlude labels properly, ability to support user interactions and clicks
• Add more data on exoplanets, stars, and galaxies
• Create a full solar system demo, then a full universe demo
• Improve the API to make it easier for people to connect Spacekit with THREE.js code
• Extend custom shadowing (e.g. rings should cast shadows onto planets!)
• Improve performance

The plan for Textbelt

• Create a comprehensive guide for self-hosting and installation
• Publish a parameterized Docker image so users don't need to go into the codebase
• Refresh the list of providers and break down the /intl endpoint to specific countries to improve reliability

The plan for CA Property Tax Map

• Add more counties!
• Figure out ways to slice data in interesting ways. For example, residential vs commercial, rental vs owned.
• Obtain other data such as square footage, estimated home value, etc.