The Right Test for the Right Patient | Beckman Coulter

 

Speaker Time Stamp Speech
Naomi Diaz 00:07 Hello, everyone. This is Naomi Diaz with Becker's Healthcare. Thank you so much for joining us for today's webinar, The Right Test for the Right Patient, a fireside chat on advancing diagnostics in the ED. Before we begin, I'll walk us through a few quick housekeeping instructions. We will begin today's webinar with a discussion and we'll have time at the end of the hour for a question and answer session. You can submit any questions you have throughout the webinar by typing them into the Q&A box you see on your screen. Today's session is being recorded and will be available after the event. You can use the same link you used to log into today's webinar to access the recording. If at any time you have issues with audio or visuals, just try refreshing your browser. You can also submit any technical questions into the Q&A box. We are here to help. With that, I am pleased to introduce today's speakers. Nathan Shapiro, Professor of Emergency Medicine and Attending Physician at Beth Israel Deaconess Medical Center and Harvard Medical School, and Melissa Nyman, Medical Director for Sepsis and Host Response at Beckman Coulter. Thank you so much, Dr. Shapiro and Dr. Naiman for being here today. I'll now turn over the floor to Dr. Naiman to get us started
Dr. Melissa Nyman 01:31 Great. Thank you so much. Nate, thanks so much for joining me today. I guess to kick off, can you tell me a little bit about your background and what brings you here and your interest in diagnostics in the emergency department in general?
Dr. Nathan Shapiro

01:44

Sure. So my name is Dr. Nathan Shapiro. I'm an emergency physician and I practice in the emergency department. I've been doing so for 25 years, and I've also been doing different kinds of sepsis research as well. And so in trying to diagnose sepsis, as we all know, it's a challenge. So looking for new tools for clinicians has been part of my career ambition or goals for a number of years now
Dr. Nathan Shapiro

01:44

Sure. So my name is Dr. Nathan Shapiro. I'm an emergency physician and I practice in the emergency department. I've been doing so for 25 years, and I've also been doing different kinds of sepsis research as well. And so in trying to diagnose sepsis, as we all know, it's a challenge. So looking for new tools for clinicians has been part of my career ambition or goals for a number of years now

Dr. Melissa Nyman

02:11

Thank you. So let's set the stage for our conversation. You walk into an exam room, you grab a little hand sanitizer, and you introduce yourself to a patient whose chief complaint is something ambiguous like cough and shortness of breath. What's going through your mind?

Dr. Nathan Shapiro

02:32

 

There's a couple kinds of questions that are going to go through my mind. As an emergency physician, one main question we usually ask is sick or not sick, right? Very easy question, two possible answers, but critically important, to identify the patients who are clearly ill or to identify the patients who are not clearly ill but at risk of becoming ill, as opposed to those patients who, with some simple supportive care, will do just fine on their own, plus or minus some oral antibiotics, et cetera. So the kinds of questions we ask is, what's making the person sick? Is it an infection? If it's an infection, what kind of infection is it? And then is that, again, is that patient going to make them sick? And what kind of supportive care will they need? Will they need intravenous fluids, intravenous antibiotics, respiratory support that needs to happen in a hospital and maybe even in an ICU setting? Or is it chicken noodle soup plus or minus some home antibiotics and they'll do okay with supportive care at home? And finally, if they are really critically ill, what kind of resuscitation tools do they need? And then something that we'll get a little bit to address a little bit more at the end of the talk, which are, are there any novel or advanced therapies that are going to be helpful for this person? Recognizing that right now, hopefully not in the future, but right now, the number of novel therapies are limited.

Dr. Melissa Nyman

04:02

So given all of those questions swirling around, how does diagnostic testing help you answer those questions?

Dr. Nathan Shapiro

04:10

 

I think I propose it could be broken down into three main buckets, so to speak. The first one is I like to call it diagnosis of infection or sepsis, which is, is the person sick from an infection? The second one is prognosis. Just how sick are they or how sick are they going to become? And the third one is treatment and response to treatment, which is what are the treatments that they need? And as we treat the patient, how are they responding to that therapy? In other words, is the current status of treatment okay? Or if they're not responding well to treatment, do we need to then deviate?

Dr. Melissa Nyman

04:52

 

So in thinking about lab tests in the context of establishing whether a patient has an infection, there are two complementary approaches. Lab tests that help identify the pathogen itself, and then tests that help measure some aspect of the host response to infection. So in the last few years, you've worked a lot on various host response diagnostics. Can you explain the difference between pathogen identification tests and host response tests, and what drew you to host response diagnostic approaches in particular?

Dr. Nathan Shapiro

05:24

 

Yeah, so great question. So for pathogen ID, that's going after the bug itself. For example, BioFire PCR looking for bacteria themselves, or in the more simple of cases, COVID PCRs, going after COVID, going after the pathogen itself, what's making the person sick. This is in contrast to the host response, which is how is the body responding to the infection? And this goes more about the pathophysiology of the response. And with that, looking some at is there a different host response or body response to different types of infection? And secondarily, what can we learn about the host response for the prognosis bucket for how sick are they going to become? That's just been my personal interest is more in the host response. To me, at the bedside, it's what we see. And finding ways to uncover a little bit more about how the host is responding at the bedside is part of the interest there. And finally, in some ways, when you get more into sepsis, you have the cause of the infection. But really, it's the host response that is probably the biggest differentiator of how sick somebody is. And so for me, that's always been the area of interest that I'm more focused on.

Dr. Melissa Nyman

06:41

 

 

Great. So once you've decided what test you want to order, how do you then incorporate those results into your patient assessment?

Dr. Nathan Shapiro

06:53

 

So this is, I mean, this is a little theoretical and academic, but I like the Bayesian approach, which is essentially I'm going to go in and make an assessment of a patient, maybe history and physical exam. They have a cough. They have a fever to 102. They're tachyptych. that's a person sick with an infection or something a little bit more subtle and less compelling. But essentially, I'd like to walk out of the room and say, I have an assessment that let's just oversimplify. My probability for an infection is low, medium, or high. I'm then going to pull in the results of those tests to help inform me and say, okay, what are my next steps going to be? So, for example, if I go in and think someone's sick and the host response confirms that, that's pretty helpful they're going in the wrong direction. If I go in and say, this person looks pretty good, but then my host response markers say, we suspect high probability of infection and or severity, that's where you're going to circle back into the room, double click on the patient, and really try and attenuate which is kind of more informative and how do I put those two pieces of information together? In other words, did I miss something on my exam? Do I need to keep them a little longer to see what direction they're going to go, et cetera? So it's really coming up with a certain assessment, pulling in the results of the testing as an adjunct to help the clinician, and then figuring out how that can get you into the best place.

Dr. Melissa Nyman

08:29

 

So, because you mentioned test accuracy as an important part of your clinical reasoning in this paradigm, I'd like to pause here and to review a few key concepts in diagnostic accuracy that I think will help us with our conversation about specific diagnostics. So, getting down to brass tacks, what we want to know about any diagnostic method is how well it matches up with the patient's true disease status. So very simply, when a patient has the disease, we want the test to be positive. And when the patient doesn't have the disease, we want the test to come back negative. And we typically use four ratios to summarize the test performance. We look at what proportion of the test results are positive in patients where the disease is present, which is sensitivity. We look at what proportion of test results are negative when the disease is absent or specificity. We look at the positive test results and see how many of those patients had the disease or positive predictive value. And we look at all the negative test results and see how many of those patients did not have the disease or negative predictive value. But these outputs are all about the test itself, not about correctly diagnosing one patient. So to answer the question, what are the chances that a positive test means that the patient actually has the disease? Or what are the chances that a negative test means that the patient doesn't have the disease? We turn to likelihood ratios. And so the positive likelihood ratio is the probability of a true positive result divided by the probability of a false positive result. And the negative likelihood ratio is the probability of a false negative result over the probability of a true negative result. So how does all this math turn into an actual clinical decision?

 

Dr. Nathan Shapiro 10:28

This is, you know, likelihood ratios are essentially asking the question, if my test result is positive, how much should it really push my revised probability? In other words, if I think there's a 50-50 chance somebody has an infection and that diagnostic test has a likelihood ratio close to one, no matter what the response is, it shouldn't really move my needle on whether now my revised probability because that particular test in that particular range isn't as helpful. However, if the likelihood ratio is, say, 10, that's really good. And so therefore, a positive test, I should really say, okay, I'm now going to have a much higher suspicion for that person having the outcome of interest. So in general, this is just a rule of thumb. But if the likelihood ratio, so a negative likelihood ratio addresses a negative test. So if it's between 0.5 and 1, it doesn't really alter it that much. the test isn't reliable enough to really alter a tremendous amount. 0.1 to 0.5 means that negative test, I'm really going to start to believe. And then if the likelihood ratio is less than 0.1, then it's really compelling that the negative test means much lower probability of having the disease or the outcome. When we look at the positive likelihood ratios, one to two, it moves it a little bit. Two to 10, now you're really starting to get helpful. And then greater than 10 means highly useful. In other words, I really believe that positive test. And so really you have to integrate these likelihood ratios with your probability of disease to try and put the whole picture together. Now, part of the reason we're bringing it up for this particular talk is if you look at the FDA approvals across the board of the diagnostics, the likelihood ratios are kind of front and center of the way that these results are being reported. And in particular, a lot of the not all, but a lot of the diagnostics for sepsis have gone into reporting the likelihood ratios in multiple bands. So there's sort of like a very low, low, moderate, and high probability with escalating likelihood ratios across the board there. So as we talk about the different tests, we're going to be referring to likelihood ratios because that's the way the tests are being reported. And you can kind of, again, use this as a don't worry too much about the math right now, but you can use this as a rule of thumb, which is 0.5 to 1 is not as helpful. 0.1 to 0.5 for a negative test is really starting to become useful, and then less than 0.1, highly useful, and then the corollary for the likelihood ratio, positive.

 

Dr. Melissa Nyman 13:22

 

Awesome. So let's apply this to some real world examples, talking about some recently cleared tests intended to differentiate infection and identify sepsis. So earlier you proposed three key decisions that diagnostic tests can help you make. So diagnosis, prognosis of therapeutic response. So let's start with diagnosing infection. I can think of three recently cleared tests that were designed to help differentiate bacterial from viral infection. So FebriDx, MimedVV, and the Triverity bacterial score. Can you give us a kind of quick overview of these three?
Dr. Nathan Shapiro 14:03

 

Sure. So FebriDx is a point-of-care test. It's a finger stick. And if you look up there, the white gadget there has both the lancet as well as the well. and it'll essentially tell you bacterial versus viral in about 10 minutes. So this is a true point of care test that works for bacterial versus viral. For MIMED, and that uses CRP, which is associated with bacterial infection, and MXA, resistance protein, associated with viral infection. And so the idea is you use the combination of whether you have high CRP or high MXA to suggest bacterial versus viral. If we look at MIMED, they use three proteins, CRP, TRAIL, and IP10, and they're going for bacterial infection as well. That is run more centrally on a lab device. You see it pictured there. Test time is about 15 minutes. Finally, trivarity, and trivarity is called trivarity because it tells you bacterial, viral, and prognosis, but the bacterial portion of Triverity will tell you bacterial infection or not. And that uses actually messenger RNA. There's 29 of them in an algorithm that differentiates the two. And the test time there is about 30 minutes, and it's cartridge-based.
Dr. Melissa Nyman 15:30

 

So I've pulled together a side-by-side from each of their FDA decision summaries. So this is kind of the best we can do in terms of what's been published and publicly available. And this is really what's supposed to be the underlying intended use for each of these tests, which I would like to note are slightly different. It's not exactly a side-by-side comparison because there were different methodological approaches. But can you walk us through your take on the diagnostic accuracy overall across these three?
Dr. Nathan Shapiro 16:05

 

Dr. Justin Marchegiani: These are -- so just remember, these are different studies in different populations with different adjudicated outcomes. So it's a little hard to really do a true side-by-side comparison. But with that caveat, the general idea is Febrit-X gives you a yes or no for bacterial, and your likelihood ratios are 0.3 and 8. Whereas MIMED, you see the range of likelihood ratios. just to point out if you're in the high likelihood of viral or really low bacterial. In the top bin, it has a likelihood ratio of 0.1, and then you go to 0.7. The 1.89, that's probably not as helpful in the particular patients who come in those zone. And then you get back to more likely with 3.4, and then finally, really helpful at 12.2. And then Triverity has a good rule out with the 0.16, goes to 0.61 the moderate zone where it's just really an equivocal test and then back to high with 1.96 and very high 5.2 so you kind of see how it's not just the test result but where in the range it occurs for how much you can really use that to alter um ruling out or ruling in as it
Dr. Melissa Nyman 17:16

 

were the bacterial infection awesome so let's move on to some of the prognostic examples So recently cleared sepsis tests in particular, so moving away from just the etiology and into recognizing sepsis. There are some single marker tests and some multi-marker signatures. So let's start with the single markers. Can you give us an overview of monocyte distribution with IntelliSep and pancreatic stone protein? Sure. So monocyte distribution with, or MDW,
Dr. Nathan Shapiro 17:53

 

is actually looks at the monocyte. They're essentially how big they are. And the idea is that when patients are not infected and not septic, there's kind of a uniform quote unquote in health distribution that tends to be about the same size. However, when the body responds, monocytes in particular respond to sepsis, they actually change in size. Some of them are small, some of them swell up and that's a sign that there's a host response to infection so it literally looks at at the distribution in other words are we in this normal range where things are a little bit more uniform or is the physiology perturbed such that we have a wide range of shapes and sizes for of the monocytes which is associated with sepsis for intellisept they actually look at the a number of different parameters with the white cells so they essentially strain stress and put put a mechanical stress on the white cells and look how they respond and to see those different parameters of the white cell responding is again more variable during an infection and so when those deformability changes occur that's what they're using in it to identify patients more likely to be septic. And the last one is pancreatic stone protein is a unique biomarker that's used to identify sepsis.
Dr. Melissa Nyman 19:20

 

So coming back to their intention intended use and the clinical studies that supported their FDA clearance, do you want to walk through kind of your take on their diagnostic accuracy of these
Dr. Nathan Shapiro 19:34

 

results? So here we see a little bit of with MDW it's less than less than or equal to 20 and greater than 20 so it's a negative or positive there you see with 0.36 and 2.6 the bands are 0.3 1 and 2.7 and then finally with PSP you see a range as well and so again we're looking for the quote-unquote diagnosis of sepsis or infection plus a host response.
Dr. Melissa Nyman 20:05

 

So I think another thing to point out with this set is how, I mean, what's your take on, say, the rule in versus rule out? Would you use these more for one versus the other?
Dr. Nathan Shapiro 20:17

 

You know, it really depends on the clinical circumstance. It still needs to be an adjunct for the clinicians. But essentially, if you have a high suspicion and someone's something saying, we're ruling it out, then you're going to again double check to make sure you're not over treating, et cetera. So you really have to just integrate the two things.
Dr. Melissa Nyman 20:41

 

Okay. So let's take a look at the multi-marker signatures. So for this, we have the Trivarity Critical Illness score, which is again part of the three-part test. There's Septocyte Lab, and there's also a rapid version that came out after and then a sepsis immunoscore
Dr. Nathan Shapiro 21:06

 

all right so triverity is the curriculum this this goes back to the same messenger rna panel so they took 29 messenger rnas and they looked for um critical illness which was were they on a vase on vasopressors received mechanical ventilation or renal replacement therapy within seven days. So that algorithm is identified, is used to make that prediction of that outcome. Septocyte is for messenger RNAs and its patients, the population was a little bit of a sicker population. It's actually ICU populations. And then they make a diagnosis of sepsis. And then finally, the sepsis immunoscore integrates up to 20, it's up to 22 EHR input. So it's a combination of demographics such as age and gender. It's vital signs and then routine clinical labs and a couple novel sepsis markers. So it's a machine learning or artificial intelligence algorithm that integrates all of those parameters to make a prediction. There, the primary outcome was sepsis within 24 hours. But then in the manuscript, it also describes prognostic implications where it can also do some risk stratification as well.
Dr. Melissa Nyman 22:28

 

Okay. So moving on to the accuracy according to, again, the summary statements from the FDA, you want to walk us through the diagnostic performance of each of these?
Dr. Nathan Shapiro 22:45

 

Sure. And keeping in mind that each of these is slightly different populations, with septicite being ICU, Triverity and sepsis immunoscore a little bit more ED-based, and then also slightly different outcomes. So keeping that in mind, it just kind of shows you that essentially when you have your very low and your very high, for example, with Triverity, it's quite helpful. Low and high still gives prognostic information in that moderate range probably um it can be thought of as an as a equivocal test and then septicite you see same kind of thing um probably the two lower bands are a bit more helpful in the high band and then finally sepsis immunoscore the very low and very high are helpful medium also pretty prognostic and high a little bit of an increase but you're not going to move it your decision making too far
Dr. Melissa Nyman 23:35

 

with that. So given that you have, I guess, the options of choosing between a single or multi-marker approach, how would you sort of differentiate between your decision to use one, the other, or
Dr. Nathan Shapiro 23:48

 

both? Well, I mean, I think at the end of the day, we're seeing these different tests with different levels of prognostic performance, but, you know, all of them in a reasonable range, which is why they got approved. I think what we're really going to have to see, in theory, you would think more is better, multi-marker is better. We also know that there's a point where there's redundancy of information. In other words, if the markers were interleukin 1, 2, 3, 4, 5, 6, 7, and 8, there's probably going to be a lot of redundancy there. But if you had a renal marker versus a coagulation marker, there might be complementary information. I think now that we have all of these studies through the FDA, I think we're going to really need to look towards post-market studies that show us how they're performing in the real world, so to speak, and then also to learn if there's different populations where they might perform better. But now what we have is a number of tests that show promise, and we're going to really have to see how they implement and what
Dr. Melissa Nyman 24:49

 

the clinical experience plays out. Excellent. So this was quite a bit to cover. So we put together quick guide to the tests that we've just covered. And given that all of them are potentially clinically useful, so we've illustrated through each of their clearances the form of utility that they are expected to provide. And that does differ based on the specific clinical populations where it was tested and some of the nuances of the trials that were used to bring their clearances to market. But I've included a few other operational details. So given that is some clinical utility, and the actual utility experienced by a given organization will differ based on what their needs are, what their populations are, and other implementation aspects, there might be some other things to consider helping you pick the right tests for the right patients in your institution. So in particular, the FebriDx and MimedVV have clearances in pediatric population. So that's 90 days and up for MIMED, starting at 12 years of age for FebDX. Another thing to consider is whether there's a high throughput platform. So that is an implication more for the laboratorians than for providers at the bedside per se. But I think overall, it could have an impact on, first of all, time to result would be one area. And then just overall workflow in the institution, going from the bedside to the lab and back. So I think it's worth noting that just picking a test to implement is only the beginning of the journey. In my experience, hospitals don't often see the value they expect from deploying a new test. From where I'm sitting, I think this often stems from failing to very clearly define the problem that this new diagnostic is intended to solve. And then clearly communicating these goals to providers. So Nate, I'd be interested to hear what you think about optimizing clinical deployment and utilization and how that ties in with improving clinical care.
Dr. Nathan Shapiro 27:08

 

It's a great question and I have to admit for this one I certainly don't have all the answers. I mean the first thing you need in order to use a test is have the test available. So there'll be different platforms that each place will have. It'll really be the clinical team using it in coordination with the lab to decide, you know, which of these tests are going to be available in their institution. For FEBRIDX, that has the advantage of it being you just need the device, whereas Triverity is a standalone. MIMED are both standalone pieces of equipment, but then there's some where they can kind of combine with other in vitro testing machines so that you can get them in your institution. So I think, number one, it's going to be what's available. The second one is, as you see with the pediatric population, that sort of starts to push you towards Febridex or MIMED. And then also Febridex and MIMED are approved for urgent cares, which is an important segment of the population. So I really think we're going to have to see how these play out. The most important thing will be getting one of these tests in your institution so then you can then start to use it in the clinical setting.
Dr. Melissa Nyman 28:20

 

And do you have any thoughts in particular about how to assess readiness in your clinical population when you're considering implementing a new test for infection or sepsis?
Dr. Nathan Shapiro 28:30

 

You know, I think we really don't know how each of these are going to play out in the nuances of of the population. So I would just advise sites to take a look at the data that's out there to talk and see what the tests, the practicalities of implementing the tests would be, and then try and get them in your institution.
Dr. Melissa Nyman 28:50

 

- Okay. So in a few minutes we have left, I want to touch on the final area where some of the emerging host response diagnostics are yet to come. There isn't anything that is FDA cleared at the moment, but there's a lot of interesting research on the horizon. Could you talk a bit about some of the emerging host response tests and what you're looking forward to having access to in the emergency department in the relatively near future?
Dr. Nathan Shapiro 29:16

 

Sure. So this is a particular area of interest of mine, which is there's some of you on the call might have heard a lot of talk about subgroups or endotypes, but essentially saying, listen, sepsis is a big, broad swath of patients. How can we find subgroups of patients that are a little bit more similar with a particular, say, pathophysiologic defect and target that particular defect? So as a very crude example, find patients with a renal injury and target them with a renal protective drug, or find patients with an endothelial injury and target them with endothelial sparing therapies. So I think the future is going to also include in host response diagnostics that third bucket that I alluded to in the beginning of the talk, which is to say, all right, as we develop new drugs for sepsis patients, what are the subgroup of patients that are preferentially going to respond to a particular therapy?
Dr. Melissa Nyman 30:17

 

Fantastic. So I wanted to share all of the decision summaries in case anybody wants to deep dive themselves, along with the references cited for the statistics. And with that, I'm going to go ahead and open this up to audience questions. Thank you, Dr. Shapiro and Dr. Neiman for such a wonderful
Naomi Diaz 30:44

 

discussion. As mentioned, we will now begin today's Q&A section. Audience, once again, please feel free to submit your questions via the Q&A box here on your screen. Now, let's get started with our question. It asks, how do the results from the diagnostic test versus bacterial versus viral infections specifically impact antibiotic prescribing patterns and contribute to antimicrobial stewardship efforts in real-world clinical practice? Are there studies demonstrating reduced unnecessary antibiotic use? Great. Well, I can start, which is, well,
Dr. Nathan Shapiro 31:24

 

the whole goal is to help to inform prescribing practices. With the idea being on the positive side to really, at the end of the day, with antibiotic stewardship, we still want to make sure that we get antibiotics to patients who have infections. So that's where the positive tests are going to push you to prescribe. But the hope is that the negative test will give clinicians, a lot of times the confidence to not prescribe an antibiotic and follow patients clinically. The other thing is from a practical perspective, as an emergency physician, or I also work in some urgent cares as well, a lot of times it's the discussion with the patient. And sometimes the, trust me, I'm a doctor, clinically I think you're fine and don't need antibiotic that discussion is still one that's met with some skepticism and i do have to say both my clinical expertise plus this objective test suggests that antibiotics aren't needed is an approach where i think antibiotic stewardship might get a bit more effective and so the idea is to use it to get the quote unquote right therapy to the right patient by assuring that we get antibiotics to those who have infection with host response and as well as giving them to those who don't. There's some small studies out there, but I can't say we have the pivotal study yet showing that this is improving antibiotic therapy. Maybe Melissa could weigh in.
Dr. Melissa Nyman 32:55

 

So I guess a couple come to mind, and again, it is early days. So to Nate's point, this is definitely not a completely signed and sealed approach at this point. We are not at the point of like, complete guidelines of you must do this based on this test. That being said, I think there is some early evidence that these types of signatures, at least in the bacterial versus viral etiology space, are being very helpful. So first study that comes to mind, if anybody wanted to go look it up, was by Kalmovich and colleagues. It came out of the Maccabi health system in Israel. And so they looked at kind of their first year of utilization. They set up a study that was really interesting. So they had integrated into their EMR a little survey. And so every time one of their providers ordered a MiMed BB test, they said, are you thinking about prescribing antibiotics? Yes, no. I mean, obviously, you have some uncertainty because you just ordered this test. So are you thinking prescribed? Not uncertain. And then when they did the discharge note, second survey popped up and said, are you, you know, did this help? You know, did you follow what it said? did you find the result helpful? And so what they found was that they looked at results from 3,200 cases in their first year of use. They found that the providers felt that the MIMED-BV result was helpful in the, like, 86% of all cases, either through supporting their decision and helping them just be more clear about what they wanted to do, or it changed their mind. And so they saw the extreme result and the situation that Nate was describing where they were open to change based on an extreme result. And so overall, there was a 78% adherence to the results of the test. So again, it's not that it's 100% of the time that you have to absolutely blindly do what a diagnostic tells you to do. I don't think anybody thinks that's a good idea. But when you're in a situation where it clinically makes sense and it all comes together as part of your decision-making, you can use these types of tests to really solidify your clinical decision and be more confident overall in your final diagnosis. The second study I would point to, it's kind of an interim trial. There was a feasibility study, again, associated with MIMED-BB called the Juno trial. It's a subset of the, a larger randomized control trial that will probably conclude sometime in 2026. So stay tuned for results from that. But again, in a randomized control trial, they showed that better adherence to the Mimed-BV result at least trended towards better outcomes in terms of re-hospitalization. So patients who followed the results were less likely to be hospitalized, more likely to receive appropriate antibiotic treatment. And then I think the third real world that came out recently from Maimonides looked at their kind first year of clinical use and being able to be more confident of sending patients home when they didn't have, when they otherwise would have drawn blood cultures. So I think those are three that come to mind for me that kind of show some inkling that there's a real world application, but obviously we're looking forward to seeing more across the entire spectrum of host response
Naomi Diaz 36:17

 

diagnostics. Thank you so much. Our second audience question asked, with regard to cases in your institution, has employment of these testing constructs reduced the number of sepsis denials by insurance carriers?
Dr. Nathan Shapiro 36:35

 

So it's a great question. I'm not intimately involved with the insurance end of our hospital, but I like the theory, and I think it's really a good hypothesis, right, which is if we can show objective testing that confirms sepsis or high likelihood of sepsis, will that help in getting the DRG for sepsis or the higher paying DRGs? So, you know, I think it's a great question. I think it ultimately could prove to be a terrific use of the test or a way for hospitals to get some return on investment by assuring those higher DRGs. But I don't have the answer with what, as far as personally, what insurance companies are doing.
Naomi Diaz 37:20

 

Thank you, Dr. Shapiro. We have another question directed to you that asks, are you using any of these tests in your daily practice? And if so, how did you as a provider build trust in the test validity toward your decision-making process and treatment decisions?
Dr. Nathan Shapiro 37:38

 

So one thing that I do is I was, as you saw in the beginning of my disclosures, as involved in a number of these trials so i kind of put up a bit of a firewall between myself and the clinical implementation or institution so we don't have a number of these tests at our institution currently especially as they're just becoming available so that said i think the really important question is how do you build trust in test validity with providers and from i can talk about from experience as new tests have come on um simply the providers need to use them and what they're going to do is gain experience with these tests and in any time you have a clinical decision and a lab test when you're well aligned it's good because it gives you confidence in that lab test but it's not really changing your management per se but when there's a discrepancy you have to see how often is that lab test quote unquote saving me because the lab test raised a flag when my clinical suspicion wasn't as high as it could have been in a patient who's sick and vice versa which is how often is the the lab test saying hey this patient's a little more healthy than you may think um conversely how how how often is there a false alarm um when they're you know saying you're sick when in fact the person's just fine and vice versa so at the end of the day i think that you You have to get these tests in, make sure that going in, it looks like there's a reasonable chance they're going to help you, and then get clinicians just used to using them. And you have to just really encourage that use to figure out if that's a test that should stay, become part of your practice or not. That's at least the way I would answer the question.
Dr. Melissa Nyman 39:21

 

So can I ask you a follow-up question? A little controversial. How do you feel about mandatory order sets, especially with a novel test? So yeah, it's a great question.
Dr. Nathan Shapiro 39:31

 

Just mandatory order sets, or I think really taken is, I like to think of it as clinical guidelines, right, is where you have essentially as an, the idea is, or the objective is, that when you have a lot of variability for a given condition, you're more prone to error. Whereas if you can say for a given set of patients, in general, this is the approach we advocate based on literature, based on experience, et cetera, you reduce the practice variability. So what I like about the order sets is that it reduces that practice variability. And so, therefore, for providers who, you know, at the end of the day, providers who might miss something, these order sets are helpful. For providers who are really just thinking thoroughly through every single patient, every single detail, maybe the order sets are going to lead to some unnecessary testing. But in general, I like them because you reduce practice variability. And then over time, you get to see what should and shouldn't be in the order set.
Dr. Melissa Nyman 40:34

 

So then how do you approach, I guess, like the cutoff point of how often would you reassess, let's say? So you do six months and see how folks feel or because that's often a struggle.
Dr. Nathan Shapiro 40:44

 

The number of tests, yeah. I think you have to have enough experience that you feel like you're seeing the correct population in a wide variety of the population and that people are in general using the tests and to see just how it's playing out over time.
Naomi Diaz 41:05

 

Thank you both so much. Another audience question asks us here, considering the site of care and high throughput platform information, what are the main implementation hurdles for integrating these novel host response texts into existing clinical workflows in different settings, especially for tests identified as not being high throughput?
Dr. Nathan Shapiro 41:28

 

Yeah, I mean, I think the timely return of a result for the proper clinical decision making is really what we're trying to figure out, right? So something like half an hour or less is usually okay in almost all circumstances. When you start to creep beyond that, it starts to get too long. If you start to get to four hours, for the circumstance of an emergency department or urgent care, it's too long. For the ICU setting, it might be okay. So I think you really just got to weigh the time with which you can get that test turned around and the clinical decision-making it's informing and what particular population you're trying to inform.
Dr. Melissa Nyman 42:10

 

I think another aspect to consider is who will physically run the test because there are some that are smaller that might be thought of as being run by providers. So there's like kind of a point of care. So keeping it near care, then there might be other considerations of how often the machine itself, the analyzer needs to be maintained, how much space it takes up, where it'll be physically put. So keeping things, say, in a core lab is where the lab stuff usually lives for the most part. Or is it something that's going to be near care? And if so, how is that going to impact the workspace, especially in EDs, which are very crowded, which do not have a ton of dedicated space for equipment, which then makes the maintenance a little harder. Because if you're rolling stuff around, then there's more risk of things being jostled. Lab equipment is a little more sensitive to that than, say, computers or other EKG machines and stuff like that. So I think that's another question is to really think about the space and the environment and how providers and laboratorians are going to interact with this particular technology and how it fits to the overall workflow. I'll say that interrupting automated lines, if anyone's been, I've been in a lot of automated labs. That's one of the poor things that we do. If you've ever seen one of these lately or if you haven't gone down to your lab lately, check it out and kind of get some appreciation for how all of this works together. Because it might be a lot more complicated than you might think. And so having that input, I think, would be important overall.
Naomi Diaz 43:52

 

Another audience question asks, what are the known rates of false positives and false negatives for these tests in specific challenging patient populations, examples of immunocompromised patients, those with chronic inflammatory conditions, or post-surgical patients? How might these affect the utility of the likelihood ratios?
Dr. Nathan Shapiro 44:15

 

Great. So I can start. Well, the false positives, false negatives, that is the information that the likelihood ratios are trying to capture. So the stronger likelihood ratios will have reduced false positives and false negatives corresponding. As far as the particular populations, you know, it's interesting because some studies excluded these populations to a greater degree than others. So for some of the populations, what you're seeing in the report is just the average including those populations and others, they're specifically excluded. So we might need new studies in order to really appreciate it, or you just might need to know that an inflamed patient, someone with underlying high degrees of inflammation, the test just might not be as accurate. So there's more unknowns in those populations.
Dr. Melissa Nyman 45:01

 

Yeah. And it's very challenging to capture everybody as part of a formal clinical trial. And so we sort of are in a position where we're trying to kind of not let perfect be the enemy of good and do the best we can to show the full, I guess, opportunity for any given diagnostic in most patients. You know, most people do not have, you know, immunocompromised status and so forth, but they do come in clusters. And that's the challenge, right? It's not like everybody is nice and evenly distributed across the country. You're going to have certain people who are clustering to certain institutions because they are specialists in cancer, for example, or transplant. So you're just naturally going to have more people of these challenging populations who are showing up in a given place. And that's always going to be, I guess, one of the difficulties in implementing something new when you have a special population. So that will involve doing possibly some more validation for your site itself and seeing how it works. So that's a possibility for the lab to undertake at a local level. And so that wouldn't be part of the FDA clearance per se, but at least for your own knowledge, you would know how it works. And then there will be post-market surveillance, as Nate said. So over time, when we have more ability to use these tests, we can look specifically at these patient populations more closely. And then you can use some combination of the literature or new FDA clearances to guide your decisions, to guide your providers.
Naomi Diaz 46:37

 

Another audience member asked the question, the presentation details both single markers and multi-marker signatures for a prognosis. What are the key situations or patient populations where a single marker panel would be preferred over a multi-marker panel and vice versa?
Dr. Nathan Shapiro 46:57

 

Yeah, so that's a tricky question. I think that, as you can tell, I'm a little conservative with my answers because I'd like to keep them data-driven. And so I don't think we know at this point because we're not seeing the direct head-to-head comparisons. In theory, multi-markers should give you multi-dimensions, but it just doesn't always play out that way. So we really have to look at kind of marker by marker. And I think in some of the validation studies that will be forthcoming, see how they do in specific populations. And then if we see any validation studies that do head-to-head comparisons, those will start to become more informative.
Dr. Melissa Nyman 47:35

 

And I guess, I mean, how do you think about the pragmatic component? Like, usually the single marker ones are a lot faster. So you're looking at turnaround times of, like, you know, a couple seconds to a couple minutes versus multi-marker stuff takes longer. I mean, it's just the nature of it. It's a little more complicated to do. Do you think that plays in at all?
Dr. Nathan Shapiro 47:53

 

I think somewhat. I think it depends. you know, I think a lot of times, and there's logistics too on where the tests are run. I mean, because even some of the times, the quicker tests that could be point of care are still run in a lab. And so I think that the test quicker is certainly better, but there's probably a window of 30 minutes or so where as long as you're under that, you're going to be okay.
Dr. Melissa Nyman 48:19

 

So I don't have a great answer. But it's an honest answer. So thank you. All right.
Naomi Diaz 48:28

 

Thank you both so much. Thank you both so much. Looking at our Q&A box, I think we have tackled them all. I want to thank, again, our Dr. Shapiro and Dr. Neiman just for an excellent presentation, as well as Bethman Coulter for sponsoring today's webinar. Thank you, audience, for joining us today, and hope you have a wonderful rest of your afternoon. All right. Thanks so much.