Florian Giroud
06/03/2026, 9:15 PMMarvin
06/03/2026, 9:15 PMMarvin
06/03/2026, 9:15 PMtext
Slack/Web UI
-> Agent service
-> LLM
-> Tool router
-> search/docs/API tools
-> Prefect flows for long-running or reliable work
Recommended stack
A pragmatic stack could be:
- Frontend/chat: Slack app or simple internal web UI
- Agent framework: your own thin orchestration layer, or an agent SDK if you prefer
- Knowledge: vector search + keyword search over docs
- Execution: Prefect for pipelines, sync jobs, and durable tasks
- Storage: Postgres for conversation/tool logs
- Auth: SSO + strict tool permissions
Important design advice
If you want this to work well internally:
- Start narrow
- one domain, one audience, one success metric
- Prefer tools over pure prompting
- reliable answers come from grounded retrieval and APIs
- Separate read vs. write actions
- read actions can be broadly available
- write actions should require approvals or confirmations
- Log everything
- prompts, tool calls, citations, user feedback
- Design for failure
- the assistant should say “I don’t know” and ask clarifying questions
If you want something Marvin-like specifically
Marvin can be a good inspiration for:
- LLM-first developer ergonomics
- structured outputs
- agent/task abstractions
But for a company assistant, you’ll usually need to add:
- auth and permissions
- retrieval over internal docs
- tool safety constraints
- observability
- workflow orchestration
- deployment/runtime concerns
Useful links:
- Marvin on GitHub
- Prefect
- Prefect docs
If you want, I can help you sketch a concrete reference architecture for:
- a Slack internal assistant
- a customer support copilot
- or an engineering ops bot built on Prefect
If you share your use case, I can make it much more specific.Jake Kaplan
06/03/2026, 9:17 PMFlorian Giroud
06/03/2026, 9:20 PM