1
0
mirror of https://github.com/sredevopsorg/deepseek-kubernetes-sandbox.git synced 2026-11-03 09:23:25 +00:00
SREDevOps.org Agent 9466449f84 fix(exposure): check SSO RBAC and NetworkPolicies in preflight (#47)
The preflight is the documented gate before real SSO traffic, but it did
not check two things the dsh-demo install got wrong:

- The gateway Role must grant `patch` on
  extensions.agents.x-k8s.io/sandboxclaims. The SSO landing path rotates
  the claim's token-hash annotation whenever the browser has no valid
  gateway session (first visit, expired or foreign cookie, gateway
  restart), so a missing verb makes every such sign-in answer 503.
  Verify with `kubectl auth can-i --as`; when a read-only kubeconfig
  cannot impersonate, fall back to reading the rules of the Role (or
  ClusterRole) the RoleBinding points at.
- The variant's NetworkPolicies must be applied. Without them any Pod in
  the cluster can reach dsh-gateway:8080 and spoof X-Forwarded-User, so
  the exposure is demo-only. Fail the preflight while either policy from
  75-networkpolicies.yaml is missing.

Also fix a false positive in the cookie-secret check: oauth2-proxy accepts
16, 24 or 32 raw bytes, or URL-safe unpadded base64 that decodes to one of
those lengths (pkg/encryption.SecretBytes). The documented
`secrets.token_urlsafe(32)` value is 43 base64 characters that decode to 32
bytes, so it is valid and must not be reported as 43 raw bytes.

The docs that enumerate the preflight checks are updated to match, and
75-networkpolicies.yaml notes that the preflight enforces it.

Verified with shellcheck, yamllint, make check and the gateway test suite
(150 passed); the new checks were exercised read-only against the live
dsh-demo cluster.

Entire-Checkpoint: 01M6FNY2WTC4GMAJ8BAHABN88M

Co-authored-by: SREDevOpsAgents <agents@sredevops.org>
2026-11-03 01:03:06 -03:00
2026-11-02 20:56:51 -03:00
2026-10-25 08:37:43 -03:00

deepseek-kubernetes-sandbox

DeepSeek Harness Web, packaged as a container. This repository's primary artifact is a slim, non-root, multi-arch image of DeepSeek Harness Web (dsh web), ready for Docker and Kubernetes. Everything else exists to support that image or to demonstrate an implementation on top of it.

The flagship implementation is examples/dsh-agents-as-a-service/: the "agents-as-a-service" platform pattern with one DSH Web instance per user, provisioned from a warm pool on kubernetes-sigs/agent-sandbox, suspended when idle, and fronted by a small browser-usable gateway.

Quick start

docker run -d --name dsh-web \
  -p 3080:3080 \
  -v dsh-home:/home/node/.dsh \
  -e DEEPSEEK_API_KEY \
  ghcr.io/sredevopsorg/deepseek-kubernetes-sandbox:dsh-v0.2.1-rc.5-r6

DSH Web is not usable at a bare /. Without its launch-token cookie it answers 401, and the token is printed only in the startup logs:

docker logs dsh-web 2>&1 | grep -m1 '?token='
# dsh web: http://localhost:3080/?token=...

Open the printed ?token=... URL once: DSH sets its auth cookie and the UI loads normally afterwards. Hitting / directly (or after the cookie expires) returns 401 by design.

Host port and public URL

If 3080 is taken locally, map another port and set the public URL so the quoted token URL matches:

docker run -d --name dsh-web -p 18081:3080 \
  -e DSH_PUBLIC_URL=http://localhost:18081 \
  -v dsh-home:/home/node/.dsh \
  -e DEEPSEEK_API_KEY \
  ghcr.io/sredevopsorg/deepseek-kubernetes-sandbox:dsh-v0.2.1-rc.5-r6
# then open http://localhost:18081/?token=...

Hosts, probes and the 401

  • Probes must not hit /. It returns 401 without the launch token, so a readiness/liveness probe on / crash-loops the pod. Probe /favicon.svg instead: it is unauthenticated. The shipped manifests use it.
  • Host allow-listing. DSH rejects unknown Host headers. localhost and 127.0.0.1 are always trusted; add any other public hostname to DSH_TRUSTED_HOSTS (comma or space separated). A gateway or Ingress that forwards the browser's Host needs its hostname listed there.
  • State lives in /home/node/.dsh. Mount a volume (Docker) or PVC (Kubernetes) to keep conversations, sessions and config across restarts.

Runtime environment

Variable Default Purpose
DEEPSEEK_API_KEY empty Provider credential consumed by DSH. Inject it; never bake it into the image or commit it.
DSH_PORT 3080 Port DSH Web listens on inside the container.
DSH_HOST auto-detected pod/container IP Bind address. Leave empty in Kubernetes.
DSH_PUBLIC_URL http://localhost:${DSH_PORT} Public base URL used in generated links and the launch-token URL in the logs.
DSH_TRUSTED_HOSTS empty Extra trusted Host/Origin entries, comma/space separated.
DSH_HOME /home/node/.dsh DSH state directory (mount a volume here).

DSH also resolves the standard per-provider environment names — OPENROUTER_API_KEY, GEMINI_API_KEY, NVIDIA_API_KEY, OPENAI_API_KEY, ANTHROPIC_API_KEY, GROQ_API_KEY, XAI_API_KEY, HF_TOKEN, and others — through its packaged provider catalog. Inject them the same way; a key saved in DSH's credential store wins over the environment. See provider credentials.

Full contract, build args, probes, volumes and signals: docs/main-image.md.

Published images

Published to GitHub Container Registry. The main image is the repository image; example components are nested packages below it:

ghcr.io/sredevopsorg/deepseek-kubernetes-sandbox                              # DSH Web (main image)
ghcr.io/sredevopsorg/deepseek-kubernetes-sandbox/dsh-agents-as-a-service/gateway   # example gateway
Tag Contents Meaning
dsh-v0.2.1-rc.5-r6 DSH Web, port 3080 Current release identity. Immutable: once published it never moves.
latest DSH Web Most recent release; same digest as the current identity.
main DSH Web Development channel rebuilt when image-definition files change on main. Not a release; not for production.

The example gateway is published under its nested path with the same release identity, e.g. ghcr.io/sredevopsorg/deepseek-kubernetes-sandbox/dsh-agents-as-a-service/gateway:dsh-v0.2.1-rc.5-r6.

Release identities, channels and rollback rules are explained in docs/versioning.md. Production deployments should pin a digest:

docker buildx imagetools inspect ghcr.io/sredevopsorg/deepseek-kubernetes-sandbox:dsh-v0.2.1-rc.5-r6
# image: ghcr.io/sredevopsorg/deepseek-kubernetes-sandbox@sha256:<digest>

Build from source

make image    # build the main DSH Web image (clones and builds upstream DSH)
make run      # build it, then run it interactively (needs DEEPSEEK_API_KEY)

The pins (DSH_VERSION, RELEASE_REVISION, PNPM_VERSION) come from versions.env — never hard-code them (make check verifies). build.sh is a deprecated shim that forwards to make; use the Makefile targets.

Examples

Self-contained implementations that consume the image. Index and contract: examples/README.md and docs/examples.md.

Example What it demonstrates
examples/dsh-agents-as-a-service/ Full multi-tenant platform: SandboxTemplate with per-user PVCs, warm pool, one claim per user, suspend-when-idle, wake-on-return, browser gateway with signup + HttpOnly sessions + HTTP/WebSocket proxy, Ingress or Gateway API + GitHub SSO exposure, and opt-in gVisor/NetworkPolicy/provider-key hardening and failed-Pod recovery. Start with the walkthrough and the architecture.
examples/minimal-single-tenant/ The smallest useful setup: one SandboxTemplate and one SandboxClaim, reached through kubectl port-forward + the launch-token URL. Manifest: manifests/10-sandboxtemplate.yaml.

The gateway is a component of the multi-tenant example and has its own README (API, configuration, auth/SSO, limitations). The example also documents opt-in gVisor, nodeSelector, NetworkPolicy and extra provider-key hardening in optional hardening.

Agent skills

DSH discovers project skills from .dsh/skills/<name>/SKILL.md. The repository ships dsh-agent-sandbox-platform, which covers operating and extending the platform, the optional agent-sandbox MCP server, and a read-only cluster preflight. Runbooks, the MCP reference, the extension guide and troubleshooting notes live beside SKILL.md.

Repository layout

Path Purpose
Dockerfile Primary artifact: the multi-stage DSH Web image (port 3080).
versions.env Single source of truth for the DSH ref, repository revision, pnpm/control-plane versions and image names.
Makefile, build.sh Canonical local entrypoint; build.sh is a deprecated shim.
docs/ Repository docs: image contract, example contract, gitflow, versioning.
examples/ One self-contained implementation per directory.
examples/dsh-agents-as-a-service/ Multi-tenant platform example: manifests/, gateway/, docs/, scripts/.
examples/minimal-single-tenant/ Single-sandbox quickstart.
scripts/ Repository checks: versions, example layout, manifest YAML, version bump.
.dsh/skills/ Project-local DSH skills, auto-discovered from the git root.
.github/ CI, release automation, dependency updates, PR/issue templates.
.env.sample Reference environment names for local runs; nothing reads it automatically. Never commit a real key.

Development

The Makefile is the canonical entrypoint. No cluster is needed for check, test, lint, gateway or image:

Target What it does
make check Version pins, example layout and manifest YAML checks. Run before every commit.
make test Gateway unit tests (pytest).
make lint ruff + shellcheck (+ yamllint/actionlint when installed).
make image Build the main DSH Web image.
make gateway Build the example gateway image locally (dsh-aaas-gateway:dev).
make e2e Full kind walkthrough of the multi-tenant example (needs a cluster with agent-sandbox).
make changelog Regenerate CHANGELOG.md with git-cliff (release only).
make set-version Bump pins in versions.env; e.g. make set-version DSH_VERSION=<ref> RELEASE_REVISION=rN.

Local setup and the PR workflow: CONTRIBUTING.md; branches, required checks and releases: docs/gitflow.md.

Versioning and releases

The release identity is the upstream DSH ref plus an optional repository revision: DSH_VERSION and RELEASE_REVISION in versions.env. The current identity is dsh-v0.2.1-rc.5-r6 — the first release at this upstream DSH ref, so it carries no repository revision. Tags are immutable; a broken release is fixed by publishing -r(N+1), never by re-tagging.

CHANGELOG.md is generated by git-cliff from Conventional Commits and is never edited by hand. See CHANGELOG.md, docs/versioning.md and cliff.toml.

Contributing

  • CONTRIBUTING.md — local setup, PR workflow, what a change needs.
  • AGENTS.md — repository conventions for AI coding agents (and humans) and the CI commands.
  • SECURITY.md — private vulnerability reporting and project threat notes.
  • CODE_OF_CONDUCT.md — community standards.
  • docs/gitflow.md — branches, protected main, required checks, release process.

Do not commit secrets; secret-shaped YAML lives in *.yaml.example files, and version pins change only through versions.env / make set-version.

License

MIT © Nicolás Georger.

Description
Run deepseek-harness (dsh) with agent-sandbox in Kubernetes
Readme MIT 2.1 MiB
Languages
Shell 64.3%
Dockerfile 19.2%
Makefile 11.6%
Python 4.9%