RankDisco Architecture Diagrams
Comprehensive Mermaid diagrams for the RankDisco system architecture.
1. System Architecture
Full system overview showing all Cloudflare bindings and external integrations.
2. Data Flow Diagram
How data moves through the RankDisco system from entry to storage.
3. Classification Pipeline
The 5-stage classification pipeline used for domains, URLs, and keywords.
4. Domain Onboard Sequence
Step-by-step workflow for onboarding a new domain.
5. Queue Topology
All queues and their relationships in the RankDisco system.
6. Storage Architecture
D1, KV, R2, and Vectorize relationships.
7. Cost Flow Diagram
How costs are tracked and attributed across the system.
8. Workflow State Machine
State transitions for the main workflows.
9. V3 Taxonomy Hierarchy
The domain classification taxonomy structure.
10. Admin Console Architecture
The admin console UI structure and API connections.
Summary Tables
Workflow Summary
| Workflow | Binding | Consumer Queue | Purpose |
|---|---|---|---|
DomainOnboardWorkflow | DOMAIN_ONBOARD_WORKFLOW | domain-onboard | Domain intelligence gathering |
DomainClassifyWorkflow | DOMAIN_CLASSIFY_WORKFLOW | domain-classify | 5-stage domain classification |
UrlClassifyWorkflow | URL_CLASSIFY_WORKFLOW | url-classify | 5-stage URL classification |
KeywordClassifyWorkflow | KEYWORD_CLASSIFY_WORKFLOW | keyword-classify | 5-stage keyword classification |
SerpTrackingWorkflow | SERP_TRACKING_WORKFLOW | - | SERP position tracking |
AppDetailsWorkflow | APP_DETAILS_WORKFLOW | app-info-fetch | App metadata enrichment |
SubscriptionDispatchWorkflow | SUBSCRIPTION_DISPATCH_WORKFLOW | - | Daily cron coordinator |
LlmVerifyWorkflow | LLM_VERIFY_WORKFLOW | - | Low-confidence re-verification |
Storage Bindings
| Binding | Type | Purpose |
|---|---|---|
DB | D1 | Main database (rankfabric_db) |
LOOKUP_CACHE | KV | URL/Domain fast lookup |
BRAND_CACHE | KV | Brand info by root domain |
PIPELINE_ACTIVITY | KV | Real-time DAG state |
R2 | R2 | Payload storage |
DFS_RAW_PAYLOADS | R2 | Raw API responses |
VECTORIZE_DOMAINS | Vectorize | Domain classifier |
VECTORIZE_BACKLINK | Vectorize | URL classifier |
VECTORIZE_KEYWORDS | Vectorize | Keyword classifier |
Cost Services
| Service | Cost | Notes |
|---|---|---|
dataforseo_backlinks | $0.02 | Per API call |
dataforseo_keywords | $0.005 | Per API call |
dataforseo_serp | $0.0035 | Per API call |
dataforseo_instant_pages | $0.000125 | Per URL |
zenrows_basic | $0.001 | Per request |
zenrows_premium | $0.01 | Per request |
cf_workers_ai | ~$0.02 | Per LLM call |
youtube_api | FREE | 10K units/day |
Classification Thresholds
| Pipeline | Early Exit | Learning Threshold | Storage |
|---|---|---|---|
| Domain | >= 65% | >= 80% | VECTORIZE_DOMAINS |
| URL | >= 70% | >= 65% | VECTORIZE_BACKLINK |
| Keyword | >= 65% | >= 70% | VECTORIZE_KEYWORDS |