Unified Model Records

Vicuna-13B

Type: model

Tags: opensource Publisher: LMSYS Org Released: 2023-03-30 v.1.0.0

Model details

Blackbox External Model Access ✓
Capabilities demonstration ✓
Capabilities description -
Centralized model documentation ✓
Evaluation of capabilities ✓
External model access protocol ✓
External reproducibility of capabilities evaluation ✓
External reproducibility of intentional harm evaluation -
External reproducibility of mitigations evaluation -
External reproducibility of trustworthiness evaluation -
External reproducibility of unintentional harm evaluation ✓
Full external model access ✓
Inference compute evaluation -
Inference duration evaluation ✓
Input modality ✓
Intentional harm evaluation -
Limitations demonstration -
Limitations description ✓
Mitigations demonstration ✓
Mitigations description ✓
Mitigations evaluation ✓
Model architecture ✓
Asset license ✓
Model components ✓
Model size ✓
Output modality ✓
Risks demonstration ✓
Risks description ✓
Third party capabilities evaluation -
Third party evaluation of limitations ✓
Third party mitigations evaluation -
Third party risks evaluation -
Trustworthiness evaluation -
Unintentional harm evaluation ✓

Intended use

  • Research and academic purposes to advance the field of natural language processing and chatbot design.
  • Developers and enthusiasts to explore chatbot technologies and implement in non-commercial projects.
  • Educational institutions for teaching concepts related to AI and chatbots.
  • Non-profit organizations to enhance their customer support or engagement through chatbots.
  • Open-source community contribution and improvement.

Dependencies

Metrics

No metrics specified.

Environmental

Source: https://github.com/meta-llama/llama/blob/main/MODEL_CARD.md#hardware-and-software

Carbon emitted (tCO2eq): 1

Energy usage: 1 w

Compute usage: 0

Ethical considerations

  • Ensure the model does not generate harmful or biased content by incorporating adequate safety measures.
  • Be transparent about the model's capabilities and limitations to users and stakeholders.
  • Consider the environmental impact of training large models and strive for more energy-efficient methodologies.
  • Respect user privacy and data protection laws, especially when dealing with conversation data.
  • Regularly review and update the model and its usage policies to address evolving ethical standards and societal expectations.

Recommendations

  • Use Vicuna-13B for experimental and research purposes to explore limitations and potential improvements.
  • Consider the ethical implications of deploying chatbots and adhere to fair use policies.
  • Because Vicuna is open-source, contributions such as bug fixes, feature enhancements, and training on diverse datasets are recommended.
  • Engage with the development community through discussions, sharing use cases, and providing feedback.
  • Stay informed about future updates and versions by following the project's official communication channels.