# cf-meta

### Speed
- bottlenecks:
- update_timestamps
- automatic grouping
- cj keyword search
- pandas aggregation
- product validation using schema
- improvements
- we can do verification run, with sampling a small amount of products and check validation (for development/debugging)
- multi processing

### stability
- checks on product count for each store
- proper exception throwing
- NaN fields/null fields

### Flexibility
- use each store as a unit, instead of feed

### other points
- better implementation practice for new feeds
- is_expired calculation

### validation
- list of fields that could fail validation
- product_id
- title

### unresolved issues
- using old data for some stores would have invalid data slipping through, those ones need to be removed from cf-updater instance (do it once manually and be done with it)