Unified Model Records

Vicuna

Type: family

Tags: opensource Publisher: LMSYS ORG Released: 2023-03-30 v.1.0.0

Model details

Blackbox External Model Access ✓
Capabilities demonstration ✓
Capabilities description -
Centralized model documentation ✓
Evaluation of capabilities ✓
External model access protocol ✓
External reproducibility of capabilities evaluation ✓
External reproducibility of intentional harm evaluation -
External reproducibility of mitigations evaluation -
External reproducibility of trustworthiness evaluation -
External reproducibility of unintentional harm evaluation ✓
Full external model access ✓
Inference compute evaluation -
Inference duration evaluation ✓
Input modality ✓
Intentional harm evaluation -
Limitations demonstration -
Limitations description ✓
Mitigations demonstration ✓
Mitigations description ✓
Mitigations evaluation ✓
Model architecture ✓
Asset license ✓
Model components ✓
Model size ✓
Output modality ✓
Risks demonstration ✓
Risks description ✓
Third party capabilities evaluation -
Third party evaluation of limitations ✓
Third party mitigations evaluation -
Third party risks evaluation -
Trustworthiness evaluation -
Unintentional harm evaluation ✓

Intended use

  • Research and academic purposes
  • Open-source innovation
  • Enhancement of chatbot technology
  • Public demonstration and education
  • Non-commercial use

Dependencies

No dependencies specified.

Metrics

No metrics specified.

Environmental

No environmental refs specified.

Carbon emitted (tCO2eq): 1

Energy usage: 1 w

Compute usage: 0

Ethical considerations

  • Potential for biased responses based on training data
  • Need for continuous monitoring to mitigate toxicity or misinformation
  • Possibility of misuse in generating deceptive or harmful content
  • Importance of transparent usage and limitations disclosure to users
  • Commitment to non-commercial use to respect data and model licensing agreements

Recommendations

  • Best suited for research, academic, and open-source development purposes
  • Use in conjunction with moderation APIs to address potential safety concerns
  • Further fine-tuning with specific datasets for targeted applications encouraged
  • Continuous evaluation and comparison with emerging models for improvements
  • Not intended for direct commercial use without proper evaluation