# AME Update 14/04/23

### Status

- First class support for datasets.
- Model validation.
- Proof of concept UI.
- Lots of internal changes.
- Poetry support.
- Finalizers

### Demo
https://youtu.be/pXIYh94ho9M
https://github.com/TeaInSpace/ame-demo.git
https://github.com/TeaInSpace/ame-dataset-demo.git
https://github.com/TeaInSpace/ame-template-demo.git

**Dataset:**

projectid: datasetdemo
dataSets:
  - name: dataset1 
    path: data
    task:
        name: dataset1_fetcher
        projectid: datasetdemo
        runcommand: python produce_data.py
        env:
          - name: S3_ENDPOINT
            value: play.min.io 
          - name: S3_ACCESS_KEY
            value: Q3AM3UQ867SPQQA43P2F
          - name: S3_OBJECT
            value: mixed_0101_gradual.csv
        secrets:
          - !AmeSecret
            name: s3secretkey
            envkey: S3_SECRET_KEY

**Model:**

projectid: sklearn_logistic_regression
models:
  - name: logreg
    type: mlflow
    validationTask:
      taskRef: mlflow_validation
    evaluation:
      trigger: hourly
      task:
          taskRef: eval_model_time
    training: 
      task:
        taskRef: training
    deployment:
      auto_train: true
      deploy: true
      enable_tls: false
tasks:
  - name: training
    projectid: sklearn_logistic_regression
    templateRef: shared-templates.logistic_reg_template
    taskType: Mlflow
    dataSet: [datasetdemo.dataset1]
    secrets:
  - name: mlflow_validation
    projectid: sklearn_logistic_regression
    runcommand: python validate.py

****

### Next steps

- Feature freeze
- Get a first release out
- maintenace
- Polish
- Dog fooding

#### Plugins

projectid: datasetdemo
dataSets:
  - name: dataset1 
    path: data
    task:
        name: dataset1_fetcher
        projectid: datasetdemo
        withPlugins:
            - name: s3reader
              args:
                  - name: S3_ENDPOINT
                    value: play.min.io 
                  - name: S3_ACCESS_KEY
                    value: Q3AM3UQ867SPQQA43P2F
                  - name: S3_OBJECT
                    value: mixed_0101_gradual.csv
                  - !AmeSecret
                    name: s3secretkey
                    envkey: S3_SECRET_KEY
          

### Questions

- What is the status regarding "my" project?

### Notes

Should be able to specify dependency manager versions.

Consider having a base AME image.

Evalution:
- periodic montioring of a model
- Use triggered monitoring