{"slug":"spider","name":"Spider","summary":"Public-web infrastructure with one API to scrape, crawl, and search, plus a browser engine and proxy network on the same key. Pages can stream back as markdown or JSON for agents and RAG.","publisher":"Spider","homepage":"https://spider.cloud","kind":"kit","hasApi":true,"hasMcp":true,"costRange":"usage","costNotes":"Page states pay as you go with no minimum: $1 per GB bandwidth plus $0.0001 per CPU minute; blocked, timed out, and failed requests are $0. Unlimited flat-rate plans from $40 a month, priced by concurrency, with unlimited requests, starting concurrency of 2 requests in flight, and per concurrent request $20 down to $13. New accounts start with a free balance; the page also says get started free and run requests before you buy. Seat pricing, full concurrency matrix, and any ongoing free-tier limits beyond the starting balance are not specified on this page.","functions":["code","browser","crawl","search","store","stream","auth","connect"],"slices":[{"functionId":"crawl","label":"Site crawl","note":"POST /crawl and one API to crawl sites; whole sites stream back as markdown in order.","cost":"$1/GB + $0.0001 per CPU minute, or unlimited from $40/month"},{"functionId":"search","label":"Web search","note":"Same host and API are stated to scrape, crawl, and search the web.","cost":"$1/GB + $0.0001 per CPU minute, or unlimited from $40/month"},{"functionId":"browser","label":"Browser engine","note":"Own browser engine with WebSocket host; scripts, lazy images, and infinite scroll are rendered.","cost":"$1/GB + $0.0001 per CPU minute, or unlimited from $40/month"},{"functionId":"stream","label":"Ordered streaming","note":"Each crawled page arrives as one JSONL line when done, in order, without waiting for the last URL.","cost":"$1/GB + $0.0001 per CPU minute, or unlimited from $40/month"},{"functionId":"code","label":"code","note":"Inferred from executor","cost":"Unknown"},{"functionId":"store","label":"store","note":"Inferred from executor","cost":"Unknown"},{"functionId":"auth","label":"auth","note":"Inferred from executor","cost":"Unknown"},{"functionId":"connect","label":"connect","note":"Inferred from executor","cost":"Unknown"}],"interfaces":[{"kind":"mcp"},{"kind":"http"}],"composabilityRationale":"Stated interfaces are a scrape/crawl/search API (including POST /crawl with streaming pages), a browser, and proxies on one API key, plus SDKs, a CLI, and an MCP server. Fits catalogue crawl, search, extract, retrieve, browser, render, and stream slices. Rate limits, SLA, and whether search/crawl/scrape share identical request semantics are not fully specified on this homepage.","signals":[],"functionProbabilities":[{"functionId":"code","value":0.92,"source":"https://spider.cloud","method":"lexical","observedAt":"2026-10-17T14:01:29.582Z"},{"functionId":"browser","value":0.8,"source":"https://spider.cloud","method":"lexical","observedAt":"2026-10-17T14:01:29.582Z"},{"functionId":"crawl","value":0.8,"source":"https://spider.cloud","method":"lexical","observedAt":"2026-10-17T14:01:29.582Z"},{"functionId":"search","value":0.8,"source":"https://spider.cloud","method":"lexical","observedAt":"2026-10-17T14:01:29.582Z"},{"functionId":"store","value":0.8,"source":"https://spider.cloud","method":"lexical","observedAt":"2026-10-17T14:01:29.582Z"},{"functionId":"stream","value":0.8,"source":"https://spider.cloud","method":"lexical","observedAt":"2026-10-17T14:01:29.582Z"},{"functionId":"auth","value":0.72,"source":"https://spider.cloud","method":"lexical","observedAt":"2026-10-17T14:01:29.582Z"},{"functionId":"connect","value":0.72,"source":"https://spider.cloud","method":"lexical","observedAt":"2026-10-17T14:01:29.582Z"},{"functionId":"extract","value":0.72,"source":"https://spider.cloud","method":"lexical","observedAt":"2026-10-17T14:01:29.582Z"},{"functionId":"memory","value":0.72,"source":"https://spider.cloud","method":"lexical","observedAt":"2026-10-17T14:01:29.582Z"},{"functionId":"retrieve","value":0.72,"source":"https://spider.cloud","method":"lexical","observedAt":"2026-10-17T14:01:29.582Z"}],"claimVerification":[{"key":"mcp","status":"unverified","asserted":"true","evidenceSource":"https://spider.cloud","method":"fallback"},{"key":"api","status":"unverified","asserted":"true","evidenceSource":"https://spider.cloud","method":"fallback"},{"key":"cost","status":"unverified","asserted":"usage","evidenceSource":"https://spider.cloud","method":"fallback"},{"key":"license","status":"unverified","asserted":"","evidenceSource":"https://spider.cloud","method":"fallback"}],"tweets":[],"notes":[],"origin":"intake","createdAt":"2026-10-17T14:01:30.396Z","updatedAt":"2026-10-17T14:01:30.396Z","sources":[{"kind":"web","label":"executor","url":"https://spider.cloud","excerpt":"# Infrastructure for reading the public web.\n\nOne API to scrape, crawl, and search, backed by our own browser engine and network. Low cost, low latency, built to scale.\n\nGet started free\n\nRun requests before you buy. Or paste the setup prom","at":"2026-10-17T14:01:30.396Z"}],"recordId":"cmp_spider","claims":{"name":"Spider","summary":"Public-web infrastructure with one API to scrape, crawl, and search, plus a browser engine and proxy network on the same key. Pages can stream back as markdown or JSON for agents and RAG.","kind":"kit","publisher":"Spider","homepage":"https://spider.cloud","costRange":"usage","costNotes":"Page states pay as you go with no minimum: $1 per GB bandwidth plus $0.0001 per CPU minute; blocked, timed out, and failed requests are $0. Unlimited flat-rate plans from $40 a month, priced by concurrency, with unlimited requests, starting concurrency of 2 requests in flight, and per concurrent request $20 down to $13. New accounts start with a free balance; the page also says get started free and run requests before you buy. Seat pricing, full concurrency matrix, and any ongoing free-tier limits beyond the starting balance are not specified on this page.","functions":["code","browser","crawl","search","store","stream","auth","connect"],"slices":[{"functionId":"crawl","label":"Site crawl","note":"POST /crawl and one API to crawl sites; whole sites stream back as markdown in order.","cost":"$1/GB + $0.0001 per CPU minute, or unlimited from $40/month"},{"functionId":"search","label":"Web search","note":"Same host and API are stated to scrape, crawl, and search the web.","cost":"$1/GB + $0.0001 per CPU minute, or unlimited from $40/month"},{"functionId":"browser","label":"Browser engine","note":"Own browser engine with WebSocket host; scripts, lazy images, and infinite scroll are rendered.","cost":"$1/GB + $0.0001 per CPU minute, or unlimited from $40/month"},{"functionId":"stream","label":"Ordered streaming","note":"Each crawled page arrives as one JSONL line when done, in order, without waiting for the last URL.","cost":"$1/GB + $0.0001 per CPU minute, or unlimited from $40/month"},{"functionId":"code","label":"code","note":"Inferred from executor","cost":"Unknown"},{"functionId":"store","label":"store","note":"Inferred from executor","cost":"Unknown"},{"functionId":"auth","label":"auth","note":"Inferred from executor","cost":"Unknown"},{"functionId":"connect","label":"connect","note":"Inferred from executor","cost":"Unknown"}],"interfaces":[{"kind":"mcp"},{"kind":"http"}],"composabilityRationale":"Stated interfaces are a scrape/crawl/search API (including POST /crawl with streaming pages), a browser, and proxies on one API key, plus SDKs, a CLI, and an MCP server. Fits catalogue crawl, search, extract, retrieve, browser, render, and stream slices. Rate limits, SLA, and whether search/crawl/scrape share identical request semantics are not fully specified on this homepage."},"relations":[{"from":"spider","to":"firecrawl","kind":"fills-same-slot-as","note":"Shared functions browser, code, crawl, search. Can fill the same function slot."},{"from":"spider","to":"context-dev","kind":"fills-same-slot-as","note":"Shared functions connect, crawl, search. Can fill the same function slot."},{"from":"spider","to":"maple","kind":"fills-same-slot-as","note":"Shared functions browser, connect, store. Can fill the same function slot."},{"from":"spider","to":"how-hopx-achieves-100ms-cold-starts","kind":"fills-same-slot-as","note":"Shared functions auth, code, store. Can fill the same function slot."},{"from":"spider","to":"executor","kind":"fills-same-slot-as","note":"Shared functions code, connect. Can fill the same function slot."},{"from":"spider","to":"box","kind":"fills-same-slot-as","note":"Shared functions code, stream. Can fill the same function slot."},{"from":"spider","to":"search","kind":"fills-same-slot-as","note":"Shared functions browser, search. Can fill the same function slot."},{"from":"spider","to":"soar","kind":"fills-same-slot-as","note":"Shared functions connect, search. Can fill the same function slot."}],"explain":{"score":13,"formula":"100 × sum(weight × value) over observed factors only. Unobserved factors are omitted, not zeroed.","factors":[{"id":"github_health","label":"GitHub health","weight":0.18,"why":"insufficient evidence","sources":[],"evidence":"insufficient"},{"id":"agent_use","label":"Agent use","weight":0.16,"why":"insufficient evidence","sources":[],"evidence":"insufficient"},{"id":"human_notes","label":"Human notes","weight":0.14,"why":"insufficient evidence","sources":[],"evidence":"insufficient"},{"id":"composability","label":"Composability","weight":0.16,"why":"insufficient evidence","sources":[],"evidence":"insufficient"},{"id":"checklist","label":"Checklist","weight":0.1,"value":1,"contribution":0.1,"why":"An MCP surface is declared. An API is declared. Cost is usage. 3 of 3 checklist fields are complete.","sources":[],"evidence":"observed"},{"id":"evidence_quality","label":"Evidence quality","weight":0.14,"value":0.18107144632819594,"contribution":0.025350002485947435,"why":"1 sources cover 1 evidence types. The latest dated evidence is 2026-10-17. Freshness is omitted unless observed as a signal.","sources":[{"kind":"web","label":"executor","url":"https://spider.cloud","excerpt":"# Infrastructure for reading the public web.\n\nOne API to scrape, crawl, and search, backed by our own browser engine and network. Low cost, low latency, built to scale.\n\nGet started free\n\nRun requests before you buy. Or paste the setup prom","at":"2026-10-17T14:01:30.396Z"}],"evidence":"observed"},{"id":"benchmark","label":"Benchmarks","weight":0.12,"why":"insufficient evidence","sources":[],"evidence":"insufficient"}],"missing":["GitHub health: insufficient evidence","Agent use: insufficient evidence","Human notes: insufficient evidence","Composability: insufficient evidence","Benchmarks: insufficient evidence"]},"score":13}