Blog

  • Mevo Accuracy Compared To Trackman (2022)

    Quick summary:

    • I compared the Mevo ($400) to the current gold standard of doppler radar launch monitors, the Trackman 4 ($19,000)
    • The Mevo performs extremely well for ball speed (on any given shot, less than 1% off)
    • The Mevo performs very well for club speed (usually less than 3% off)
    • The Mevo performs pretty well for carry (usually less than 5% off)
    • Spin and launch angle are highly erratic and are almost unusable (20-60% off)
    • Below are the simplest and fastest graphs to summarize the accuracy:

     

    Overview, methods:

    Picture of Mevo next to a Trackman 4 unit
    Where the magic happened….

    The Mevo ($450) is a portable radar launch monitor, which uses Doppler radar to measure different parameters of a golf shot. There is a wide variety of launch monitors at various price points, but at the top end for radar models is the Trackman 4 (starting at $18,995), which is the gold standard I used for these tests. Owning one is impractical for almost everyone outside of pros and coaches, but thankfully they can be rented for $30/hour where I live. I spent a couple sessions hitting on one and comparing its read of each shot to the Mevo. Both devices were calibrated for the altitude I usually play at in Akron (1,000 ft. above sea level).

    Data was collected indoors with 8 feet of unobstructed ball flight. Reflective metallic stickers were used on each ball to improve accuracy, per the recommendations of Flightscope. I used Taylormade TP5x’s for all shots. I include “2022” in the title because a disgusting amount of data interpretation happens behind the scenes with these companies and their proprietary calculations, and Flightscope’s firmware updates improve accuracy even as the hardware remains the same.

    I think it’s realistic to break this down to two parts – accuracy for individual shots, and accuracy for club gapping purposes (i.e., looking at averages for 5-10 shots with each club). For the latter, if someone hits 10 shots with each club, the individual variation doesn’t matter as much so long as the averages are close to the true (Trackman) averages. So for individual shots, I’m going to avoid using “average % error” as that could smooth out any nuance if the Mevo mixes over-reads with under-reads – it would improperly return a value very close to zero. I’ll use the absolute value of % difference on each shot. I’ll show the % difference for individual shots for a couple sets of data (there is too much data for this to be practical for each shot and club). For session averages, these will be true averages.

     

    Below is some of the raw data after I pasted everything from both Trackman and Flightscope’s websites to Excel:

    Example of some of the data used to generate these graphs

    Results: Comparing session averages (5-15 shots with each club)

    Results: Comparing the parameters for individual shots:

    For 16 swings of a driver, I compared the ball speed (mph) that Trackman measured and the ball speed that Mevo measured. Below is the percent difference from Trackman’s speed that Mevo’s measured on these 16 individual swings. The Mevo never missed a shot and never differed by more than 0.8%. On average, it slightly misread on the high side. It is important to point out that the differences here are extremely minute – the session average on Trackman was 149.2mph, whereas Mevo’s was 148.8mph. This difference is too small to have any actionable impact, even on a professional fitting.

    Below is the same data for the other parameters:

    Results: Average difference from Trackman (Abs):

    As discussed above, I think using the absolute value of the difference from Trackman on each individual shot is a fair way to gauge “how far from the true value might this be?” when you are using your Mevo on the range and receive a carry distance or ball speed. So below is the average of this difference on each shot:

    Discussion:

    Mevo performed admirably given the price point and its competitors. Its ball speed measurements are effectively indistinguishable from Trackman. At 160mph, a 0.5% difference would be reading 159.2-160.8mph, which is not significant enough for anyone to care about, outside of robotic equipment testing. Club speed is largely consistent, if slightly more inaccurate. Launch angle was consistently over-estimated. Spin was highly erroneous. Carry is influenced by spin and launch, and poorly read spin numbers influenced carry distance at times. To give an example, here is a tale of two reads with a 4 Hybrid shot that I struck thin:

    • Trackman: 127.2mph, 14.8* launch, 3300 spin → 199.1 yard carry
    • Mevo: 127.1mph, 20.8* launch, 7250 spin → 175.6 yard carry

    The gruesomely over-estimated spin and launch lead to a low carry distance, even though Mevo nailed the ball speed.

    I think the best use of the Mevo is if you have some sort of baseline familiarity with your launch monitor numbers, particularly ball speed. For people trying to build swing speed, ball speed is an important parameter to watch when using your driver. And the Mevo’s ball speed is effectively indistinguishable from your true (Trackman) ball speed. If Mevo reads a spin of 6,000rpm on a well struck driver shot, it is useful to be able to say “I know that’s not true” and throw out the carry distance, which would be skewed, while understanding the ball speed is still fine to interpret.

    Limitations:

    Trackman isn’t infallible, and even though it was treated as the ‘true’ values, it’s only an estimate. In indoor settings some professionals prefer photometric launch monitors (e.g., GC Quad). Its true strength lies in outdoor use where it can track the full flight of a shot. As these tests were performed indoors, they are limited. However Trackman likely represents the technical limitation of Doppler radar launch monitors as of 2022, and my goal was to see how close a $400 device can come to this standard.

    I also wonder how the prescence of more than one radar device affects reading. These units are effectively floodlights, however instead of visible light from a bulb, it’s longer radio waves emitted from an antenna (or in the case of Trackman, an array of multiple antennae at different frequencies). I wonder if the additional radiation from Trackman would actually improve the performance of the Mevo, which is normally limited by its small size and its meager power as a battery-operated device. If anyone has experience in signal processing and has insight… feel free to email me!

     

    I will add more data with irons this fall as I have time.

     

  • Can You Take a 12-Lead ECG on the Apple Watch?

    Quick summary:

    • Yes, you can! ✅
    • I used a Series 7 GPS, however anything going back to the Series 4 will work (excluding the SE)
    • Breakdown by leads:
      • Limb leads (I, II, III) all can be recorded easily ✅
      • Augmented leads (aVL, aVR, aVF) can still be measured by the Apple Watch but they require an extra step – this step involves using a wire and I did not go through the trouble of it (steps to accomplish this can be seen in this professor’s article)
      • Precordial leads (V1-V6) can be successfully approximated and multiple methods will work ✅
    • Below is an image of an ECG I made from my own heart, following the methods characterized in this article:
    • At the bottom of the article I include an actual heart attack as measured by an Apple Watch (compared to the patient’s professional ECG)

    Overview:

    The art of using a 1-lead device (or 2-electrode device) to record all 12 ECG leads is not new – in 2008, Dr. Grier at NDSU outlined the framework for doing this with handheld devices, far before smart watches even hit the market. However, unlike those 16 year old devices and even new home ECG readers (e.g., Kardia’s products), Apple Watches offer a ubiquity that makes them interesting for this purpose if chest pain strikes in a location with forcibly delayed healthcare access (skiing, hiking, airplanes).

    Measuring I, II, III, aVL, aVF, aVR:

    Leads I, II, and III can be easily measured on the Apple Watch. The watch uses its back crystal as the positive electrode and the crown as the negative electrode. Below is a sketch of how Lead I can be measured. Leads II and II can be similarly measured.

    Due to overwhelming demand from readers – here is a schematic of how I took this photo (it was not easy)
    • Lead I: Watch on left wrist, right finger on crown
    • Lead II: Watch on lower abdomen, right finger on crown
    • Lead III: Watch on lower abdomen, left finger on crown
    • Augmented leads (if desired): try this website from Dr. Grier, or this guide

    The augmented leads are a bit more complicated. Unlike the other leads which are largely just the potential difference between two different points on our body, the augmented leads are calculated. Their calculation averages two locations and then uses the actual potential from another location – the same professor mentioned above, Dr. Grier, has a very nice graphic that explains it better than I can:

    eHeart: Introduction to ECG EKG

    Measuring these leads would thus involve using a wire to connect different body parts (e.g., left arm and left leg), then holding that to the watch, while the other part (e.g., right arm) completes the circuit on the watch. I did not have wire handy and also wanted to simulate a situation where someone could be in a remote or inaccessible location (e.g., skiing, on a plane, etc.) where an Apple Watch is the only tool they have.

    Measuring Precordial Leads, V1-V6:

    We unfortunately must take an aside to discuss ECG theory because discussion of precordial leads is nonsense without exploring it. Leads I-III have easy to understand measurements, much like connecting a multimeter to the positive and negative end of an AA battery, there is a positive and negative electrode, and the difference in potential between them is easily measured. The precordial leads (V1-V6) overly the chest wall at 6 different positions, however they don’t have a clearly apparent second electrode. There is no actual second electrode, but instead a theoretical position deep in the chest (under the heart) known as Wilson’s Central Terminal to which the precordial leads are compared. That theoretical point obviously doesn’t have a lead placed on it but is approximated by averaging all the limb leads and treating that potential as the reference to which the precordial leads are compared against. It is assumed to be nearly zero and unchanging during the cardiac cycle.

    The details and derivation of this are discussed in detail in a 1975 text, “Bioelectromagnetism: Principles and Applications of Bioelectric and Biomagnetic Fields” by Malmivuo and Plonsey, which is by far the best text on this subject that I have found. In section 15.3 of this text, the precordial leads specifically and Wilson’s Central Terminal are discussed.

    Wilson’s original description of why it was necessary to develop an “indifferent electrode” and how his team at UMich accomplished it.
    Wilson, et. al, (1934). Electrocardiograms that represent the potential variations of a single electrode. American Heart Journal, 9(4), 447-458.

    The original publications are in the American Heart Journal, whose volumes from 1932-1934 are archived online for free. In summary, Wilson’s Central Terminal cannot be faithfully created on an Apple Watch without connecting all of your limbs with copper wires and then connecting that to one of the Apple Watch electrodes. This is unwieldy and defeats the purpose of a portable, wearable ECG. However, there are means to approximate it which are effective. I found two approaches in the literature to this approximation:

    1. Using the right arm (wrist) as an approximation was the simplest approach, and was described and validated by a cardiologist in this 2019 publication
    2. Using the right arm (wrist) with the left wrist wrapped around it, as described in this 2019 publication by German cardiologists
      • They called their precordial leads “Wilson-like” leads
      • Their methodology involved only recording V1, V4 and V6 as recording more was cumbersome for patients (after measuring all 6 myself, I’m inclined to agree)
      • Their methodology was tested on actual STEMI patients, and their Apple Watch ECGs were used by cardiologists to successfully identify not only infarct, but the location of the infarct (LAD).

    For my own measurements, I was intrigued by the second approach, so I performed it by their methodology as follows:

    • V1: Watch on right 4th intercostal space (ICS), right index finger on crown with left hand wrapped around right wrist
    • V2: Watch on left 4th ICS, right index finger on crown with left hand wrapped around right wrist
    • V3: between V2 and V4
    • V4: Watch on left 5th ICS, mid clavicular line, right index finger on crown with left hand wrapped around right wrist
    • V5: Watch on left 5th ICS, anterior axillary line, right index finger on crown with left hand wrapped around right wrist
    • V6: Watch on left 5th ICS, mid axillary line, right index finger on crown with left hand wrapped around right wrist

    I would suggest following an image like this one if you plan to replicate this yourself.

    My Own ECG:

    Below is the monstrosity I spent the last 30 minutes recording, outputting as 9 separate PDFs, then stitching together in Photoshop. Of note, these are not simultaneous readings from each lead, but 9 discrete intervals recorded individually.

    Brief overview of how this 9-lead ECG does and doesn’t provide more information than a 1-lead ECG:

    • Rate:
      • could be obtained on one lead
    • Rhythm:
      • likewise to above
    • PR:
      • The interval would be unchanged regardless of the number of leads but we do get new information with multiple views of the PR segment. Additional information about reciprocal changes has implications for ischemia and atrial morphology (e.g., Liu’s criteria for atrial infarct/ischemia, changes in V1 seen with right / left atrial enlargement which we now have access to on the precordial leads)
    • QT:
      • likewise to above
    • Axis:
      • lack of aVF would initially appear limiting, however I being positive and III being (roughly) isoelectric suggests my QRS axis is normal and something like +30 degrees. So the added leads do give us more information in yet another way.
    • R-wave progression:
      • Definitely not possible on a 1-lead ECG
    • ST segments:
      • Definitely not possible on a 1-lead ECG unless changes are only in lateral leads. My ST segments are visualized and lie on the baseline on every lead. I’m a bad patient as I am guessing I don’t have any current ischemia, and this ECG supports that (2024 update; I remain alive so I suspect that I was correct).  In studies where patients have had actual ST segment elevations, MI patients have been followed with these sort of Apple Watch 6 or 9-lead recreations… they have routinely been detected!

    Discussion:

    Academics who have published on this topic have published interesting results such as using actual STEMI patients, comparing the Watch ECGs to professionally performed ones, as well as having actual cardiologists perform blind reads of ECGs to assess sensitivity and specificity. The results have consistently shown that the Apple Watch, while unwieldy, can perform largely accurate ECGs.

    An undergraduate student’s December 2020 review article on this topic, “Einthoven and precordial lead accuracy of smartwatch-acquired electrocardiographs: a review of the literature”, can be found here. It is a great discussion of the underlying electrophysiology, successes, and limitations of this topic.

    I think the most interesting cases are taking actual STEMI patients and seeing how accurately the Apple Watch could measure them. Out of Italy, this 2020 JAMA Cardiology article used Series 4 Apple Watch ECGs to record 100 patients (54 STEMIs, 27 NSTEMIs, 19 controls). In their supplemental materials, they included a comparison of a STEMI as perceived by the Apple Watch vs. their standard ECG equipment:

    From Spaccarotella, C. A. M., Polimeni, A., Migliarino, S., Principe, E., Curcio, A., Mongiardo, A., … & Indolfi, C. (2020). Multichannel electrocardiograms obtained by a smartwatch for the diagnosis of ST-segment changes. JAMA cardiology, 5(10), 1176-1180.

     

    I think there is true utility to these, but only in very specific scenarios where access to medicine is forcibly delayed. If transit to a hospital is possible, then precious door-to-balloon time would be wasted as you place an Apple Watch in 9-12 various spots over your bare chest and arms. However, situations that come to mind are remote recreation (skiing, hiking), airplane travel, and catastrophe, where most owners of Apple Watches would be expected to have them on-hand, and there is a forced delay until emergency personnel can get you to a hospital / cath lab.

    The natural follow up question to this is whether or not this hyper-early detection (not only pre-ED but pre-ambulance!) would actually change outcomes. I’m not sure I’m qualified to answer that. The impact of early ECGs on STEMI care has been explored in several studies, however those have been more directed at whether or not having paramedics perform ECGs pre-hospital will improve outcomes.

    This article was last updated November 2024.

  • 2021 NFL All-COVID Team (Offense)

    Aaron Rodgers headlines our 2021 All-COVID team. Photo by me, September 30, 2012.

    I am honored to present the 2021-22 NFL All-COVID team, presented by the PFFA*, with the motto “COVID got their guy”. Defensive selections to be announced in a follow up post.

    *PFFA, the Pro Football Fans Association, is not a real association and its only member is me. For legal reasons I’d like to emphasize that I have no relationship to the NFL. 

    Brief selection notes:

    This is my selection of an All-Pro team that only consists of those who contracted COVID this season. Players who contracted COVID only during the 2020 season were not considered eligible (e.g., Trent Williams). Players who contracted it during the camps and OTAs that preceded the 2021 season were considered eligible (e.g., Penei Sewell). Players needed to test positive for the virus – only landing on the COVID list doesn’t count as that includes players in the protocol for a close contact, etc.

    The offensive selections:

    Offense
    PositionFirst teamSecond team
    QuarterbackAaron Rodgers, Green BayLamar Jackson, Baltimore
    Running backDalvin Cook, MinnesotaAustin Ekeler, Los Angeles
    Wide receiverDavante Adams, Green BayMike Evans, Tampa Bay
    Tyreek Hill, Kansas CityKeenan Allen, LA Chargers
    Amari Cooper, Kansas CityMike Williams, LA Chargers
    Tight endTravis Kelce, Kansas CityDarren Waller, Las Vegas
    Left tackleRashawn Slater, Los AngelesTaylor Lewan, Tennessee
    Left guardQuenton Nelson, IndianapolisJon Feliciano, Buffalo
    CenterCorey Linsley, Los AngelesMatt Paradis, Carolina
    Right guardZach Martin, DallasMark Glowinski, Indianapolis
    Right tacklePenei Sewell, DetroitD.J. Humphries, Arizona