Aryan SinghandClaude Opus 5
cb985dcf9c
One endpoint in front of every free LLM tier, with automatic failover and no provider key ever leaving the box. Providers are data, not code: adding one is a JSON file plus an env var, never a TypeScript change. Ships 12 providers pre-written; `verify-provider --apply` derives the live model list from your own key. - core: registry, bucketed quota meter (rolling + UTC-calendar windows), key-pool store, 6-step model router with diagnostic rejection reasons - gateway: node:http, failover that commits to a stream only after 200 headers, SSE passthrough with usage sniffing, virtual keys with admin/inference roles - context engine: sqlite sessions and a 5-rung refit ladder, so a 128k thread keeps working when it fails over to an 8k model - cache: exact (sha256, safe-by-default) + opt-in semantic (flat Float32Array) - guard: inbound limits, quota forecasting, limit calibration from upstream headers, key health, secret/PII/injection scanning - dashboard: one self-contained HTML file, live SSE request log, token usage - sdk: zero-dep typed client, drop-in for the OpenAI SDK Zero runtime dependencies. 326 tests, 27-check smoke suite against a scripted mock upstream so routing is testable without spending quota. Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
49 lines
1.3 KiB
YAML
49 lines
1.3 KiB
YAML
name: CI
|
|
|
|
on:
|
|
push:
|
|
branches: [main]
|
|
pull_request:
|
|
workflow_dispatch:
|
|
|
|
concurrency:
|
|
group: ci-${{ github.ref }}
|
|
cancel-in-progress: true
|
|
|
|
jobs:
|
|
build-test:
|
|
name: build & test (node ${{ matrix.node }})
|
|
runs-on: ubuntu-latest
|
|
strategy:
|
|
fail-fast: false
|
|
matrix:
|
|
# 22 is the floor the package declares; 24 catches breakage early.
|
|
node: ['22', '24']
|
|
|
|
steps:
|
|
- uses: actions/checkout@v4
|
|
|
|
- uses: actions/setup-node@v4
|
|
with:
|
|
node-version: ${{ matrix.node }}
|
|
cache: npm
|
|
|
|
- run: npm ci --no-audit --no-fund
|
|
|
|
- name: Typecheck and build
|
|
run: npm run build
|
|
|
|
- name: Test
|
|
run: node --test packages/*/test/*.test.ts
|
|
|
|
- name: Verify every shipped provider file parses
|
|
run: |
|
|
node --input-type=module -e "
|
|
import { Registry } from './packages/core/dist/registry.js';
|
|
const reg = new Registry({ dir: 'providers', env: {} });
|
|
const errors = reg.issues().filter(i => i.level === 'error');
|
|
for (const i of reg.issues()) console.log(\`[\${i.level}] \${i.file}: \${i.message}\`);
|
|
if (errors.length) { console.error(\`\${errors.length} provider file(s) failed to parse\`); process.exit(1); }
|
|
console.log(\`ok — \${reg.all().length} providers loaded\`);
|
|
"
|