Recent News

Crowd-sourcing medical performance reviews -

Urologist Dr. Tom Lendvay has long been an advocate of warming up before performing robotic surgery, but he'd still like more feedback.

"As a surgeon - and I've been practicing for 10 years now - I still can benefit from improvement. I still ask my peers to come in and shadow me, if there's time. There typically isn't time," said Dr. Lendvay.

No time. That's why he and his colleagues came up with a crowd-sourcing platform called C-SATS (Crowd-Sourced Assessment of Technical Skills) that within two to three hours gives surgeons and other health care workers performance reviews. But it may surprise you who can do the evaluating: anyone.


Well, almost anyone. First you do have to pass a test. Co-founder Derek Streat says it only takes a minute.

"The crowd workers look at those side by side comparisons and make a call as to who has the more fluid motion or better technique and 75% of the people get it right," said Dr. Lendvay.

Dr. Lendvay says it comes down to one thing.

"It's all about pattern recognition. So if you were to go to a concert recital or an NBA basketball game, you could probably tell who the best player is on the court," said Dr. Lendvay.

To be clear, the crowd workers don't evaluate how well the surgery went, but assess such things as did the surgeon use both hands, not just the dominant one? Or did a nurse follow the prescribed check list when using a medical device?

"Our mission is to improve the performance of individuals," said Dr. Lendvay.

To prove that evaluations could be done by non-experts, they used an obsolete Ebola training video that had to be scrapped even before it was completed, thanks to the new CDC guidelines.

"It was very reinforcing that our crowds identified the same errors in that training video that were identified by the content experts," said Dr. Lendvay.

The evaluators get paid, roughly a dollar per video.

That's another reason results come back fast, really fast.

"Within two minutes there would be somebody somewhere around the world. They might be all the way on the other half of the world that would be rating your performance," said Streat.

Their study showed that it takes about 30 reviews to get a comprehensive assessment for surgery, 10 for a simple checklist.

"We don't view this as a surveillance tool, but we view this as something that helps people continually improve," said Dr. Lendvay.

For that reason, the videos are all anonymous. Evaluators don't know whom they are evaluating.

Although C-SATS is strictly for the medical field at the moment, the company sees a potential use for evaluating such things as sports performance and police-community interactions.

The UW spinoff just raised. $2.5 million to further expand the company.

To qualify as a crowd worker through Amazon Mechanical Turk, click here.

Read or Share this story:

Original Link...

0 comentarios