Aryan SinghandClaude Opus 5
cb985dcf9c
One endpoint in front of every free LLM tier, with automatic failover and no provider key ever leaving the box. Providers are data, not code: adding one is a JSON file plus an env var, never a TypeScript change. Ships 12 providers pre-written; `verify-provider --apply` derives the live model list from your own key. - core: registry, bucketed quota meter (rolling + UTC-calendar windows), key-pool store, 6-step model router with diagnostic rejection reasons - gateway: node:http, failover that commits to a stream only after 200 headers, SSE passthrough with usage sniffing, virtual keys with admin/inference roles - context engine: sqlite sessions and a 5-rung refit ladder, so a 128k thread keeps working when it fails over to an 8k model - cache: exact (sha256, safe-by-default) + opt-in semantic (flat Float32Array) - guard: inbound limits, quota forecasting, limit calibration from upstream headers, key health, secret/PII/injection scanning - dashboard: one self-contained HTML file, live SSE request log, token usage - sdk: zero-dep typed client, drop-in for the OpenAI SDK Zero runtime dependencies. 326 tests, 27-check smoke suite against a scripted mock upstream so routing is testable without spending quota. Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
32 lines
933 B
JSON
32 lines
933 B
JSON
{
|
|
"name": "freeway",
|
|
"version": "0.1.0",
|
|
"private": true,
|
|
"type": "module",
|
|
"description": "Self-hosted, OpenAI-compatible gateway + registry + SDK for free-tier API providers",
|
|
"engines": {
|
|
"node": ">=22"
|
|
},
|
|
"workspaces": [
|
|
"packages/core",
|
|
"packages/gateway",
|
|
"packages/sdk"
|
|
],
|
|
"scripts": {
|
|
"build": "tsc --build",
|
|
"clean": "tsc --build --clean",
|
|
"test": "npm run build && node --test packages/*/test/*.test.ts",
|
|
"test:core": "npm run build && node --test packages/core/test/*.test.ts",
|
|
"start": "node packages/gateway/dist/bin.js",
|
|
"dev": "node --watch packages/gateway/src/bin.ts",
|
|
"smoke": "node scripts/smoke.mjs",
|
|
"verify-provider": "node scripts/verify-provider.mjs",
|
|
"new-provider": "node scripts/new-provider.mjs",
|
|
"mock": "node scripts/mock-upstream.js"
|
|
},
|
|
"devDependencies": {
|
|
"@types/node": "^22.10.0",
|
|
"typescript": "^5.9.0"
|
|
}
|
|
}
|