Skip to content

Commit 9337116

Browse files
domantas-jurkus-dcddomantas-jurkus-dcd
authored
feat: replace username+password with single base64 token (#44)
* feat: replace user+pass with base64 token
1 parent 46414d0 commit 9337116

11 files changed

Lines changed: 8995 additions & 5278 deletions

File tree

‎.env.example‎

Lines changed: 3 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -1,2 +1,5 @@
11
DECODO_SAPI_HOST=https://scraper-api.decodo.com
2+
3+
SCRAPER_API_TOKEN=<token>
4+
25
ENABLE_MCPS_LOGGER=false

‎README.md‎

Lines changed: 33 additions & 15 deletions
Original file line numberDiff line numberDiff line change
@@ -20,14 +20,16 @@ services, streamlining access to our tools and capabilities.
2020
- Simple integration. Seamless setup with popular MCP clients like Claude Desktop, Cursor, and
2121
Windsurf.
2222

23-
## Connecting to [Decodo's MCP server](https://mcp.decodo.com/mcp)
23+
## Authenticating
2424

2525
1. Go to [decodo.com](https://decodo.com/scraping/web) and start a Web Scraping API plan (free plan
2626
available).
2727

2828
2. Once your plan has started, obtain a Web Scraping API basic authentication token from the
2929
[dashboard](https://dashboard.decodo.com/).
3030

31+
## Connecting to [Decodo's MCP server](https://mcp.decodo.com/mcp) (Claude Code, Cursor)
32+
3133
3. Open your preferred MCP client and add the following configuration:
3234

3335
```
@@ -41,6 +43,23 @@ services, streamlining access to our tools and capabilities.
4143
}
4244
```
4345

46+
## Claude Desktop
47+
48+
```
49+
{
50+
"mcpServers": {
51+
"Decodo MCP Server": {
52+
"command": "npx",
53+
"args": ["@decodo/mcp"],
54+
"env": {
55+
"SCRAPER_API_TOKEN": "<web_scraping_api_base64_token>",
56+
"TOOLSETS": "web,ai"
57+
}
58+
}
59+
}
60+
}
61+
```
62+
4463
## Running the MCP server locally
4564

4665
<details>
@@ -90,8 +109,7 @@ this:
90109
"command": "node",
91110
"args": ["/Users/your.user/projects/decodo-mcp/build/index.js"],
92111
"env": {
93-
"SCRAPER_API_USERNAME": "your_username",
94-
"SCRAPER_API_PASSWORD": "your_password"
112+
"SCRAPER_API_TOKEN": "<web_scraping_api_base64_token>"
95113
}
96114
}
97115
}
@@ -133,31 +151,31 @@ The server exposes the following tools:
133151
| `scrape_as_markdown` | Scrapes any target URL, expects a URL to be given via prompt. Returns results in Markdown. | Scrape peacock.com from a US IP address and tell me the pricing. |
134152
| `screenshot` | Captures a screenshot of any webpage and returns it as a PNG image. | Take a screenshot of github.com from a US IP address. |
135153
| `google_search` | Scrapes Google Search for a given query, and returns parsed results. | Scrape Google Search for shoes and tell me the top position. |
136-
| `google_ads` | Scrapes Google Ads search results with automatic parsing. | Scrape Google Ads for laptop and show me the top ads. |
137-
| `google_lens` | Scrapes Google Lens image search results with automatic parsing. | Search Google Lens for this image: https://example.com/image.jpg |
138-
| `google_ai_mode` | Scrapes Google AI Mode (Search with AI) results with automatic parsing. | Ask Google AI Mode: What are the top three dog breeds? |
154+
| `google_ads` | Scrapes Google Ads search results. | Scrape Google Ads for laptop and show me the top ads. |
155+
| `google_lens` | Scrapes Google Lens image search results. | Search Google Lens for this image: https://example.com/image.jpg |
156+
| `google_ai_mode` | Scrapes Google AI Mode (Search with AI) results. | Ask Google AI Mode: What are the top three dog breeds? |
139157
| `google_travel_hotels` | Scrapes Google Travel Hotels search results. | Search Google Travel Hotels for hotels in Paris. |
140158
| `amazon_search` | Scrapes Amazon Search for a given query, and returns parsed results. | Scrape Amazon Search for wireless keyboard. |
141-
| `amazon_product` | Scrapes Amazon Product page with automatic parsing. | Scrape Amazon product B09H74FXNW and show me the details. |
142-
| `amazon_pricing` | Scrapes Amazon Product pricing information with automatic parsing. | Get pricing for Amazon product B09H74FXNW. |
143-
| `amazon_sellers` | Scrapes Amazon Seller information with automatic parsing. | Get information about Amazon seller A1R0Z7FJGTKESH. |
144-
| `amazon_bestsellers` | Scrapes Amazon Bestsellers list with automatic parsing. | Show me Amazon bestsellers in electronics. |
159+
| `amazon_product` | Scrapes Amazon Product page. | Scrape Amazon product B09H74FXNW and show me the details. |
160+
| `amazon_pricing` | Scrapes Amazon Product pricing information. | Get pricing for Amazon product B09H74FXNW. |
161+
| `amazon_sellers` | Scrapes Amazon Seller information. | Get information about Amazon seller A1R0Z7FJGTKESH. |
162+
| `amazon_bestsellers` | Scrapes Amazon Bestsellers list. | Show me Amazon bestsellers in electronics. |
145163
| `walmart_search` | Scrapes Walmart Search for a given query, and returns parsed results. | Scrape Walmart Search for camping tent. |
146-
| `walmart_product` | Scrapes Walmart Product page with automatic parsing. | Scrape Walmart product 15296401808. |
164+
| `walmart_product` | Scrapes Walmart Product page. | Scrape Walmart product 15296401808. |
147165
| `target_search` | Scrapes Target Search for a given query, and returns parsed results. | Scrape Target Search for kitchen appliances. |
148-
| `target_product` | Scrapes Target Product page with automatic parsing. | Scrape Target product 92186007. |
166+
| `target_product` | Scrapes Target Product page. | Scrape Target product 92186007. |
149167
| `tiktok_post` | Scrapes a TikTok post URL for structured data (e.g. engagement, caption, hashtags). | Scrape this TikTok post: https://www.tiktok.com/@nba/video/7393013274725403950 |
150168
| `tiktok_shop_search` | Scrapes TikTok Shop Search for a given query, and returns parsed results. | Scrape TikTok Shop Search for phone cases. |
151169
| `tiktok_shop_product` | Scrapes TikTok Shop Product page. | Scrape TikTok Shop product 1731541214379741272. |
152170
| `tiktok_shop_url` | Scrapes TikTok Shop page by URL. | Scrape this TikTok Shop URL: https://www.tiktok.com/shop/s?q=HEADPHONES |
153171
| `youtube_metadata` | Scrapes YouTube video metadata. | Get metadata for YouTube video dFu9aKJoqGg. |
154-
| `youtube_channel` | Scrapes YouTube channel videos with automatic parsing. | Scrape YouTube channel @decodo_official. |
172+
| `youtube_channel` | Scrapes YouTube channel videos. | Scrape YouTube channel @decodo_official. |
155173
| `youtube_subtitles` | Scrapes YouTube video subtitles. | Get subtitles for YouTube video L8zSWbQN-v8. |
156174
| `youtube_search` | Search YouTube videos. | Search YouTube for "How to care for chinchillas". |
157175
| `reddit_post` | Scrapes a specific Reddit post. | Scrape the following Reddit post: https://www.reddit.com/r/horseracing/comments/1nsrn3/ |
158-
| `reddit_subreddit` | Scrapes Reddit subreddit results with automatic parsing. | Scrape the top 5 posts on r/Python this week. |
176+
| `reddit_subreddit` | Scrapes Reddit subreddit results. | Scrape the top 5 posts on r/Python this week. |
159177
| `reddit_user` | Scrapes a Reddit user profile and their posts/comments. | Scrape this Reddit user: https://www.reddit.com/user/IWasRightOnce/ |
160-
| `bing_search` | Scrapes Bing Search results with automatic parsing. | Search Bing for laptop reviews. |
178+
| `bing_search` | Scrapes Bing Search results. | Search Bing for laptop reviews. |
161179
| `chatgpt` | Search and interact with ChatGPT for AI-powered responses and conversations. | Ask ChatGPT to explain quantum computing in simple terms. |
162180
| `perplexity` | Search and interact with Perplexity for AI-powered responses and conversations. | Ask Perplexity what the latest trends in web development are. |
163181

0 commit comments

Comments
 (0)