I spent a recent afternoon querying three major chatbots—Google Gemini, Meta Llama 3, and ChatGPT—on some medical questions that I already knew the answers to. I wanted to test the kind of information that AI can provide.

“How do you go surfing while using a ventilator?” I typed.

It…