Skip to content
Live
Official sources
Mar 11Mon
  1. LangChain Blog

    How does Dosu improve the reliability of large language models through evaluation-driven development?

    Dosu enhances the reliability of large language models through evaluation-driven development (EDD), using LangSmith to monitor and search activities to address challenges brought by growth. The team adopts the EDD process to improve core logic, models, or prompts, ensuring maintenance of performance and improvement of weak points. The LangSmith SDK provides the necessary fine-grained control and customization, supporting the management of prompts as code and tracking metadata.

Dec 7Thu
  1. Anthropic Research

    Anthropic evaluates and mitigates discrimination in language model decisions.

    Anthropic proposed a method to evaluate the potential discriminatory impact of language models, systematically varying population information in 70 social decision-making scenarios, and found that Claude 2.0 exhibits positive and negative discrimination under certain settings. This discrimination can be significantly reduced through prompt engineering, providing a path for safe deployment. The team has released related datasets and prompts.