Responsible AI
- Fairness
- Explainability
- Privacy and Security
- Safety
- Controllability
- Veracity and Robustness
- Governance
- Transparency
Amazon bedrock
It has model eveluation and model monitoring capabilities, which can help us to monitor the performance of the model and to identify any issues or areas for improvement.
Sagemaker Clarify
- Bias detection: It can help us to detect bias in our data and models, which can help us to ensure that our models are fair and unbiased.
- Model evaluation: It can do the evaluation continuously.
- Explainability: It can help us to understand how our models are making predictions, for example showing which features are most important for the model’s prediction.
Sagemaker Model Monitor
We can get alerts for inaccurate responses.
Amazon Augemented AI
It insert humans in the loop to help correct results.
ML Design Principles
- Assign Ownership and Accountability: It is important to assign ownership and accountability for the machine learning models and their outcomes.
- Provide protection: we need to have security controls.
- Enable Resiliency: We need to design our machine learning systems to be resilient to failures and to be able to recover quickly from any issues that may arise.
- Enable Regularity: We need to design our machine learning systems to be able to handle regular updates and changes to the data and the models.
- Enable Reproducibility: We need to design our machine learning systems to be able to reproduce results and to be able to track changes to the data and has the version control.
- Optimise resource and reduce cost.
- Enable automation: CI/CD, CT.
- Enable continuous improvement: monitoring and analysis.