Andrew Brown • almost 2 years ago
Download Game Data S3, Line Fix and Question about XML
I suppose its a public bucket so I can maybe use AWS CLI to discover folders, but it would be nice if it clearly said which paths the XML data is in. The python script doesn't appear to target that data.
There a bug in the script for downloading via python all the json data.
download_gzip_and_write_to_json(f"games/{esports_game['platformGameId']}")
This line of code needs to change the inner quotations or it will throw an error.
Comments are closed.

4 comments
Saurabh Kumar • almost 2 years ago
i have downloaded data but inside games folder i'm not able to see anything. But size of games folder is 60gb. why?
Andrew Brown • almost 2 years ago
Couldn't say why. The amount of data I downloaded came out to 128 GB, greater than listed.
Saurabh Kumar • almost 2 years ago
how much it took for you to download entire data using python script?
Vishal sharma • almost 2 years ago
I think we don't have download complete data.