Skip to content

Latest commit

 

History

History

e-commerce-nested

Folders and files

NameName
Last commit message
Last commit date

parent directory

..
.parameters/api
.parameters/api
 
 
api
api
 
 
utils
utils
 
 
.env.example
.env.example
 
 
.gitignore
.gitignore
 
 
Intuned.jsonc
Intuned.jsonc
 
 
README.md
README.md
 
 
pyproject.toml
pyproject.toml
 
 

README.md

e-commerce-nested Intuned project

E-commerce store scraper template for sites with category-based navigation. Scrapes categories, product listings, and detailed product information.

Key Features

  • Category-Based Navigation: Automatically discovers and scrapes all product categories from store menus
  • Three-Step Workflow: Categories → Product Lists → Product Details using extend_payload chaining
  • Dynamic API Chaining: Each API automatically triggers the next step in the scraping workflow
  • Comprehensive Product Data: Extracts titles, prices, sizes, descriptions, shipping, and returns information

Run on Intuned

Run on Intuned

Development

NOTE: All commands support --help flag to get more information about the command and its arguments and options.

Install dependencies

uv sync

After installing dependencies, intuned command should be available in your environment.

Run an API

uv run intuned run api category .parameters/api/category/default.json
uv run intuned run api list .parameters/api/list/default.json
uv run intuned run api details .parameters/api/details/default.json

Save project

uv run intuned provision

Reference for saving project here

Deploy project

uv run intuned deploy

intuned-browser: Intuned Browser SDK

This project uses Intuned browser SDK. For more information, check out the Intuned Browser SDK documentation.

Project Structure

/
├── .parameters/                      # Test parameters for APIs
│   └── api/
│       ├── category/
│       │   └── default.json
│       ├── list/
│       │   └── default.json
│       └── details/
│           └── default.json
├── api/                              # API endpoints
│   ├── category.py       # Scrape category links from menu
│   ├── list.py           # List products from category page
│   └── details.py        # Extract detailed product info
├── utils/                            # Utility modules
│   └── types_and_schemas.py         # Type definitions and Pydantic models
├── Intuned.jsonc                    # Intuned project configuration
└── pyproject.toml                   # Python project dependencies

APIs

API Description
category Entry point that scrapes all category links from the store's main navigation menu. Automatically triggers list for each category using extend_payload
list Scrapes product listings from a specific category page. Automatically triggers details for each product using extend_payload
details Extracts comprehensive product information including title, price, available sizes, description, shipping details, and returns policy

Learn More