An open-source Dofus encyclopedia scraper. Scrape your desired encyclopedia categories and save it to your configured database.
The most important categories of the encyclopedia have been scraped, if you feel like some information about items are missing, feel free to open an issue or contribute.
The 'MODE' environment variable is configurable in the following modes.
existing - the scraper will look for existing .json files.
new - the scraper will fetch the newest data.
Create a .env file in the root of your project, a typical .env should look like this. You can also copy the contents of the .env.example file in the root directory.
DB_TYPE=mongodb
HOST=localhost
PORT=27017
DB_NAME=dofus-scraper
MODE=existing
However, this project is using TypeORM, so the use of database is to your preference. When your .env is configured, run one of the following commands to start the scraping.
npm run existing
npm run new
- Equipment
- Sets
- Weapons
- Resources
- Pets
- Ceremonial items
- Mounts
- Consumables
- Bestiary
- Idols
- Professions
- Classes
- Sidekicks
- Haven bags
- Harnesses