Whats this rock!
  • Getting Started
  • Tutorial
  • Resources
    • Telegram Rock Classifier Chatbot
    • Keras-CV
    • Tensorflow (tutorial)
    • nbdev (docs)
  • Help
    • Report an Issue

Download dataset

  • Download
    • Download dataset
    • Download utilities
  • Preprocess
    • Preprocess Data
  • Exploratory Data Analysis
    • Exploratory Analysis
  • Config Management
    • Hydra
  • Training models
    • Training
    • Training utilities
    • Training models
    • Callbacks
  • MLOps
    • Experiment Tracking
    • HyperParameter Tuning
    • Model Management
  • Telegram Bot
    • Telegram bot deployment

On this page

  • Create directory structure
  • Download and verify the data
    • download_and_move_datasets

Report an issue

Download dataset

We’ll create the project directory structure and download the datasets.
  • We’ll create and use some bash scripts to create a directory structure for our project
  • We’ll be following the project template by cookiecutter - by datadriven

Create directory structure

and if data already exists, clean it!

$ rocks_clean_data

Download and verify the data

$ rocks_download_data

Downloads Dataset1 and moves the extracted files to data/1_extracted/dataset1.

Downloads Dataset2 and moves the extracted files to data/1_extracted/dataset2.


source

download_and_move_datasets

 download_and_move_datasets ()

Run the download and move datasets script.