My Genie Got It Wrong: Evaluating LLMs for a RAG Chatbot
How do you choose the right LLM for a RAG chatbot? I compared Llama 70B, 405B, and GPT-4 across 100 iterations. The AI agent's recommendation was wrong.
Latest
Quality Coach newsletter #39
A round-up of quality coach articles, events and articles from the quality coach book and community.
Introducing the Quality Coach Researcher
I wrote The Quality Coach's Handbook as a practical guide, something you can pick up for an answer when a question at work arises. Now I wonder if a chatbot could supplement the book by quickly locating relevant content?
I decided to build the Quality Coach Researcher, an
The girl in the purple jeans
The girl in the purple jeans plucks at her embroidered threads.
The sun shines on her face, blessing her.
She plucks a flower and twirls it between her fingers.
How can she know that in that moment, she’s to become a symbol of
a time when no fear exists,
Have Your Slice and Eat It: Boost Quality with Vertical Story Slicing
How product features are sliced into smaller work items has a big impact on quality. Slice your epics well, and quality will follow.
There are no bad testers only bad systems
Avoid labelling people as good or bad testers, focus on how to improve the system
Quality Coach newsletter #39
Monthly newsletter by Anne-Marie Charrett on all things quality.
📖 Quality Coach newsletter #31
A round-up of quality coach articles, events and articles from the quality coach book and community. Please share!
📖 Quality Coach newsletter #30
A round-up of quality coach articles, events and articles from the quality coach book and community
Quality Coach newsletter #29
A round-up of quality coach articles, events and articles from the quality coach book and community
💃Quality Coach newsletter #28
A round up of quality coach articles, events and articles from the quality coach book
💰Quality Coach newsletter #27
💰The cost of change
Framing change in the language of business can be an effective way to communicate strategy to business stakeholders and senior management. And there's nothing like talking money to get their attention.
Boehm knew this and used this language in the 1980s when he explored
🔭 Quality Coach newsletter #26
🔭 Tails don't wag dogs do
Knowing what you can and can't control helps manage expectations. Over time, you can look for ways to incorporate some of these factors into your circle of influence. This article includes a download to help you determine what you can and
🔭 Quality Coach newsletter #25
🔭 3 Lens Quality Assitance Model
The three-lens quality assistance model encourages you to consider the role of a quality coach in the context of your existing product engineering constructs. How will a quality coach impact these teams and the organisation? How will people need to think differently? How must roles
