rortizmerino commited on
Commit
434f5fa
Β·
1 Parent(s): 928d0d4

Get README info from DagsHub/Cookiecutter-MLOps

Browse files
Files changed (1) hide show
  1. README.md +77 -2
README.md CHANGED
@@ -1,3 +1,78 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
- license: mit
3
- ---
 
 
 
1
+ Cookiecutter-MLOps
2
+ ==============================
3
+
4
+ A cookiecutter template employing MLOps best practices, so you can focus on building machine learning products while
5
+ having MLOps best practices applied.
6
+
7
+ Instructions
8
+ ------------
9
+ 1. Clone the repo.
10
+ 2. Run `make dirs` to create the missing parts of the directory structure described below.
11
+ 3. *Optional:* Run `make virtualenv` to create a python virtual environment. Skip if using conda or some other env manager.
12
+ 1. Run `source env/bin/activate` to activate the virtualenv.
13
+ 4. Run `make requirements` to install required python packages.
14
+ 5. Put the raw data in `data/raw`.
15
+ 6. To save the raw data to the DVC cache, run `dvc add data/raw`
16
+ 7. Edit the code files to your heart's desire.
17
+ 8. Process your data, train and evaluate your model using `dvc repro` or `make reproduce`
18
+ 9. To run the pre-commit hooks, run `make pre-commit-install`
19
+ 10. For setting up data validation tests, run `make setup-setup-data-validation`
20
+ 11. For **running** the data validation tests, run `make run-data-validation`
21
+ 12. When you're happy with the result, commit files (including .dvc files) to git.
22
+
23
+ Project Organization
24
+ ------------
25
+
26
+ β”œβ”€β”€ LICENSE
27
+ β”œβ”€β”€ Makefile <- Makefile with commands like `make dirs` or `make clean`
28
+ β”œβ”€β”€ README.md <- The top-level README for developers using this project.
29
+ β”œβ”€β”€ data
30
+ β”‚Β Β  β”œβ”€β”€ processed <- The final, canonical data sets for modeling.
31
+ β”‚Β Β  └── raw <- The original, immutable data dump
32
+ β”‚
33
+ β”œβ”€β”€ models <- Trained and serialized models, model predictions, or model summaries
34
+ β”‚
35
+ β”œβ”€β”€ notebooks <- Jupyter notebooks. Naming convention is a number (for ordering),
36
+ β”‚ the creator's initials, and a short `-` delimited description, e.g.
37
+ β”‚ `1.0-jqp-initial-data-exploration`.
38
+ β”œβ”€β”€ references <- Data dictionaries, manuals, and all other explanatory materials.
39
+ β”œβ”€β”€ reports <- Generated analysis as HTML, PDF, LaTeX, etc.
40
+ β”‚Β Β  └── figures <- Generated graphics and figures to be used in reporting
41
+ β”‚Β Β  └── metrics.txt <- Relevant metrics after evaluating the model.
42
+ β”‚Β Β  └── training_metrics.txt <- Relevant metrics from training the model.
43
+ β”‚
44
+ β”œβ”€β”€ requirements.txt <- The requirements file for reproducing the analysis environment, e.g.
45
+ β”‚ generated with `pip freeze > requirements.txt`
46
+ β”‚
47
+ β”œβ”€β”€ setup.py <- makes project pip installable (pip install -e .) so src can be imported
48
+ β”œβ”€β”€ src <- Source code for use in this project.
49
+ β”‚Β Β  β”œβ”€β”€ __init__.py <- Makes src a Python module
50
+ β”‚ β”‚
51
+ β”‚Β Β  β”œβ”€β”€ data <- Scripts to download or generate data
52
+ β”‚Β Β  β”‚Β Β  β”œβ”€β”€ great_expectations <- Folder containing data integrity check files
53
+ β”‚Β Β  β”‚Β Β  β”œβ”€β”€ make_dataset.py
54
+ β”‚Β Β  β”‚Β Β  └── data_validation.py <- Script to run data integrity checks
55
+ β”‚ β”‚
56
+ β”‚Β Β  β”œβ”€β”€ models <- Scripts to train models and then use trained models to make
57
+ β”‚ β”‚ β”‚ predictions
58
+ β”‚Β Β  β”‚Β Β  β”œβ”€β”€ predict_model.py
59
+ β”‚Β Β  β”‚Β Β  └── train_model.py
60
+ β”‚ β”‚
61
+ β”‚Β Β  └── visualization <- Scripts to create exploratory and results oriented visualizations
62
+ β”‚Β Β  └── visualize.py
63
+ β”‚
64
+ β”œβ”€β”€ .pre-commit-config.yaml <- pre-commit hooks file with selected hooks for the projects.
65
+ β”œβ”€β”€ dvc.lock <- constructs the ML pipeline with defined stages.
66
+ └── dvc.yaml <- Traing a model on the processed data.
67
+
68
+
69
+ --------
70
+
71
+ <p><small>Project based on the <a target="_blank" href="https://drivendata.github.io/cookiecutter-data-science/">cookiecutter data science project template</a>. #cookiecutterdatascience</small></p>
72
+
73
+
74
  ---
75
+
76
+ To create a project like this, just go to https://dagshub.com/repo/create and select the **Cookiecutter DVC** project template.
77
+
78
+ Made with 🐢 by [DAGsHub](https://dagshub.com/).