The TCG Collector database and Pokémon TCG data in general are managed using the TCG Collector CLI. For general usage help, the --help option can be used with any of its subcommands.
Crawl the cards using the TCG Collector CLI with the TCG regions, expansions, and/or card number ranges specified. The files required for the expansions argument can be exported using the tcgc cms export expansions command. The Pokédex file can be crawled using the tcgc ptcg crawl pokedex command.
Export the TCG Collector expansions:
tcgc \\
cms \\
export \\
expansions \\
/home/user/Desktop/expansions
Crawl the Pokédex:
tcgc \\
ptcg \\
crawl \\
pokedex \\
/home/user/Desktop/pokedex.json
Crawl the cards:
tcgc \\
ptcg \\
crawl \\
cards \\
--tcg-regions 'Japan' \\
--expansions 'Scarlet & Violet Promos' \\
--card-number-ranges '071/SV\\-P-500/SV\\-P' \\
--no-tcg-region-output-subdirs \\
--no-expansion-output-subdirs \\
'Bulbapedia' \\
/home/user/Desktop/expansions \\
/home/user/Desktop/pokedex.json \\
/home/user/Desktop/sv-p-promos
Check the crawling issues & limitations if any of the crawled data needs to be fixed. Be sure not to skip this step! Also double check card variants, especially for promotional cards! Also see the conventions regarding assigning card variants.
If a crawler produces partial or incomplete data, the tcgc ptcg assign card-properties command can be used to cross-assign card property values.
4. After fixing errors, use the TCG Collector CLI to analyze the changes: Be warned that this is a superficial check that can’t validate everything!
```bash
tcgc \\
ptcg \\
analyze \\
cards \\
/home/user/Desktop/sv-p-promos
```
Crawl the card images using the TCG Collector CLI if it wasn’t available as an option when crawling cards. If not all card images can be crawled, manually download and assign the imageReference property for each card.
tcgc \\
ptcg \\
crawl \\
card-images \\
--tcg-regions 'Japan' \\
--no-tcg-region-output-subdirs \\
'PokemonCard' \\
/home/user/Desktop/expansions \\
/home/user/Desktop/card-images-japan
Assign the crawled images to the cards using the TCG Collector CLI:
tcgc \\
ptcg \\
assign \\
card-images \\
/home/user/Desktop/card-images-japan \\
/home/user/Desktop/sv-p-promos
Optionally, the illustrators can be overridden:
tcgc \\
ptcg \\
assign \\
card-images \\
--override-illustrators \\
/home/user/Desktop/card-images-japan \\
/home/user/Desktop/sv-p-promos
Create the cards on TCG Collector using the TCG Collector CLI CMS:
tcgc \\
cms \\
create \\
cards \\
/home/user/Desktop/sv-p-promos
If applicable, map the TCGplayer prices using the TCG Collector CLI CMS:
Fetch the TCGplayer crawler data:
rclone \\
sync \\
--s3-access-key-id 's3-access-key-id' \\
--s3-secret-access-key 's3-secret-access-key' \\
--s3-region 'us-east-005' \\
--s3-endpoint '<https://s3.us-east-005.backblazeb2.com>' \\
--s3-provider 'AWS' \\
--checksum \\
--fast-list \\
--verbose \\
':s3:tcgplayer-crawler-data' \\
/home/user/Desktop/tcgplayer-crawler-data
Show the TCGplayer groups with unhandled products:
tcgc \\
cms \\
tcgplayer \\
show-unhandled-groups \\
/home/user/Desktop/tcgplayer-crawler-data/unhandled-products
Map the unhandled TCGplayer products:
tcgc \\
cms \\
tcgplayer \\
map-unhandled-products \\
/home/user/Desktop/tcgplayer-crawler-data/unhandled-products \\
/home/user/Desktop/tcgplayer-crawler-data/product-mappings \\
/home/user/Desktop/tcgplayer-crawler-data/skipped-products
Map the unhandled TCGplayer products for a specific group:
tcgc \\
cms \\
tcgplayer \\
map-unhandled-products \\
--groups 'SWSH: Sword & Shield Promo Cards' \\
/home/user/Desktop/tcgplayer-crawler-data/unhandled-products \\
/home/user/Desktop/tcgplayer-crawler-data/product-mappings \\
/home/user/Desktop/tcgplayer-crawler-data/skipped-products
Remap certain TCGplayer products:
tcgc \\
cms \\
tcgplayer \\
remap-products \\
--product-ids '475994,35899,69854' \\
/home/user/Desktop/tcgplayer-crawler-data/product-mappings \\
/home/user/Desktop/tcgplayer-crawler-data/skipped-products
Remap certain TCGplayer groups:
tcgc \\
cms \\
tcgplayer \\
remap-products \\
--groups 'SWSH: Sword & Shield Promo Cards' \\
/home/user/Desktop/tcgplayer-crawler-data/product-mappings \\
/home/user/Desktop/tcgplayer-crawler-data/skipped-products
Synchronize the TCGplayer product mappings:
tcgc \\
cms \\
tcgplayer \\
sync-product-mappings \\
/home/user/Desktop/tcgplayer-crawler-data/product-mappings
Upload the TCGplayer crawler data:
rclone \\
sync \\
--s3-access-key-id 's3-access-key-id' \\
--s3-secret-access-key 's3-secret-access-key' \\
--s3-region 'us-east-005' \\
--s3-endpoint '<https://s3.us-east-005.backblazeb2.com>' \\
--s3-provider 'AWS' \\
--checksum \\
--fast-list \\
--verbose \\
/home/user/Desktop/tcgplayer-crawler-data \\
':s3:tcgplayer-crawler-data'
When adding non standard or parallel set card variants, Always include a markdown description! For examples, use the TCG Collector CLI CMS:
tcgc \\
cms \\
show \\
card-variants \\
--has-description-md
Searching for specific descriptions is also possible:
tcgc \\
cms \\
show \\
card-variants \\
--description-md-search 'Part of a description'