eleutherai/lm-evaluation-harness
A framework for few-shot evaluation of language models.
01 / MACHINE INTELLIGENCE
Models you can run. Agents you can inspect. Tools you can build on.
← All topicsA framework for few-shot evaluation of language models.
Agent teams for OpenCode. Run multiple agents in parallel with messaging, shared tasks, and coordinated execution.
Agentic runtime | Multi-provider concurrent dispatch | Self-improving error memory | Pluggable tool extensions | Sandbox execution
Desktop Companion for Hermes Agent.
Authenticated email gateway for AI agents — SPF/DKIM verified inbound, HMAC-signed delivery, webhook + WebSocket fan-out, CLI + SDKs
A lightweight, vanilla JS, open source BYOK (Bring Your Own Key) clone of the Google Antigravity UI. It currently features a live xterm.js terminal with direct local file system sync and a sidebar agent capable of running commands and editing files. Built in pure HTML/CSS/JS for maximum speed and zero installation.
Build, Evaluate, and Optimize AI Systems. Includes evals, RAG, agents, fine-tuning, synthetic data generation, dataset management, MCP, and more.
One brain for all your agents.
Open-source testing platform where AI agents navigate your app end-to-end and catch regressions on every PR. No test code required.
Tessera — a workspace for organizing AI coding sessions across projects, collections, tabs, panes, and Git worktrees
Multi-lens code review pipeline for Claude Code: deep review (Claude or Codex), auto-fix loop, interactive walkthrough, external-finding injection.
🦞+🔬 NanoResearch: The Autonomous AI Research Assistant
Open Source Reliability Harness: Make your agents follow rules. One line of code to enforce, trace, and improve. - GitHub - open-bias/open-bias: Open Source Reliability Harness: Make your agents follow rules. One line of code to enforce, trace, and improve.
Manage multiple Claude Code, OpenCode agents from either TUI or Web for easy access on mobile. Also supports Mistral Vibe, Codex CLI, Gemini CLI, Pi.dev, Copilot CLI, Factory Droid Coding. Uses tmux and git worktrees.
What started as an opinionated Claude Code setup kit is now an autonomous AI engineering command center
Modular framework for building trading systems with polyglot strategy bindings and AI-friendly developer tools.
Pure Rust Inference Engine.
The best-benchmarked open-source memory system for AI coding assistants
LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar
A CLI tool for logging and analyzing Claude Code and Cursor ai-driven coding session.
The agent that grows with you.
Run deepseek4 locally on metal right from within Pi
AI-native ontology engine: a Rust MCP server with tools for building, validating, querying, and reasoning over RDF/OWL ontologies. In-memory Oxigraph triple store, native OWL2-DL tableaux reasoner, SHACL validation, SPARQL, versioning. Single binary, no JVM.
Vouch compiles human-owned intent into obligations, links evidence artifacts to those obligations, and produces deterministic release decisions for agent-written changes.