Machine Learning (ML) Feature Store Platform
A Machine Learning (ML) Feature Store Platform is a purpose-build data platform to manage ML feature sets.
- Example(s):
- See: ML Model Store, Machine Learning Platform.
References
2021
- https://aws.amazon.com/sagemaker/feature-store/
- QUOTE: Amazon SageMaker Feature Store is a fully managed, purpose-built repository to store, update, retrieve, and share machine learning (ML) features.
Features are the attributes or properties models use during training and inference to make predictions. For example, in a ML application that recommends a music playlist, features could include song ratings, which songs were listened to previously, and how long songs were listened to. The accuracy of a ML model is based on a precise set and composition of features. Often, these features are used repeatedly by multiple teams training multiple models. And whichever feature set was used to train the model needs to be available to make real-time predictions (inference). Keeping a single source of features that is consistent and up-to-date across these different access patterns is a challenge as most organizations keep two different feature stores, one for training and one for inference.
Amazon SageMaker Feature Store is a purpose-built repository where you can store and access features so it’s much easier to name, organize, and reuse them across teams. SageMaker Feature Store provides a unified store for features during training and real-time inference without the need to write additional code or create manual processes to keep features consistent. SageMaker Feature Store keeps track of the metadata of stored features (e.g. feature name or version number) so that you can query the features for the right attributes in batches or in real time using Amazon Athena, an interactive query service. SageMaker Feature Store also keeps features updated, because as new data is generated during inference, the single repository is updated so new features are always available for models to use during training and inference.
- QUOTE: Amazon SageMaker Feature Store is a fully managed, purpose-built repository to store, update, retrieve, and share machine learning (ML) features.
2020
- https://www.featurestore.org/
- QUOTE: ... We bring interesting and technical content to the world of AI with sugar on top. ...
- QUOTE: ... We bring interesting and technical content to the world of AI with sugar on top. ...
- featurestore.org.table.20210114.jpg
Caption2
Feature Store Comparison
Point-in-Time Queries
Hudi Queries
shared libraries